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This  report  responds  to  your  request  that  we  review  the  Environmental  Protection  Agency’s 
(epa)  activities  to  regulate  the  efficacy  of  disinfectants.  Specifically,  it  describes  the  nature 
of  the  scientific  controversies  surrounding  EPA-recommended  methods  and  performance 
standards  for  testing  the  efficacy  of  disinfectants,  efforts  epa  has  made  to  obtain  objective 
research  to  resolve  these  controversies,  the  adequacy  of  era’s  internal  controls  to  ensure  the 
quality  and  integrity  of  registrant-submitted  efficacy  data,  post-registration  efforts  era  and 
the  states  have  implemented  to  ensure  that  disinfectants  on  the  market  are  effective,  and  the 
need  and  options  for  a  laboratory  to  research  and  test  the  efficacy  of  disinfectants. 


Unless  you  publicly  release  its  contents  earlier,  we  will  make  no  further  distribution  of  this 
report  until  30  days  from  the  date  of  this  letter.  At  that  time,  we  will  send  copies  of  the 
report  to  appropriate  congressional  committees;  the  Administrator,  era;  and  other  interested 
parties. 


This  report  was  prepared  under  the  direction  of  Richard  L.  Hembra,  Director,  Environmental 
Protection  Issues,  whom  you  may  contact  at  (202)  275-6111  if  you  or  your  staff  have  any 
questions.  Other  major  contributors  are  listed  in  appendix  II. 
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Executive  Summary 

Purpose 

Disinfectants — about  a  $1  billion  per  year  market — are  used  to  kill 
germs  on  inanimate  surfaces  and  objects  in  hospitals,  schools,  restau¬ 
rants,  and  homes.  Because  users  cannot  see  whether  disinfectants  kill 
bacteria,  fungi,  and  viruses,  the  use  of  ineffective  disinfectants  poses  a 
threat  to  public  health  and  wastes  consumer  dollars. 

i 

Mounting  concerns  about  whether  hospital  and  household  disinfectants 
work  as  claimed  and  the  adequacy  of  the  Environmental  Protection 
Agency’s  (epa)  disinfectants  program  led  the  House  Committee  on  Gov¬ 
ernment  Operations  to  request  that  GAO  review  era’s  regulation  of  the 
efficacy  of  disinfectants. 

Background 

Under  the  Federal  Insecticide,  Fungicide,  and  Rodenticide  Act  (fifra), 

EPA  generally  must  register  (license)  pesticide  products,  including  disin¬ 
fectants,  before  they  are  marketed,  era  may  register  a  pesticide  product 
only  if  ERA  determines  that  it  is  effective,  when  used  as  claimed,  without 
causing  an  unreasonable  risk  to  health  or  the  environment.  For  most 
pesticides,  era  allows  the  marketplace  to  regulate  product  performance 
(efficacy)  because  users  can  see  whether  the  pesticide  is  effective 
against  the  target  pest.  However,  registrants  of  disinfectants  intended  to 
protect  public  health  must  submit  efficacy  data  to  substantiate  each 
product  performance  claim  and  use. 

Until  1982,  era  conducted  limited  preregistration  confirmatory  and  post¬ 
registration  enforcement  tests  on  disinfectants  at  its  laboratory  facilities 
in  Beltsville,  Maryland,  era  discontinued  disinfectant  testing  in  1982  pri¬ 
marily  because  of  budget  constraints.  Currently,  era  relies  on  its  review 
of  registrant-submitted  efficacy  data  to  register  disinfectants.  As  of  Sep¬ 
tember  1, 1989,  about  4,100  disinfectants  for  public-health  use  were  reg¬ 
istered  with  ERA,  representing  about  18  percent  of  approximately  23,000 
registered  pesticide  products. 

Results  in  Brief 

ERA  does  not  know  whether  disinfectants  kill  the  germs  claimed  on 
product  labels  for  four  reasons.  First,  although  the  validity  of  methods 
and  performance  standards  used  to  assess  the  efficacy  of  disinfectants 
has  been  the  source  of  scientific  controversy  for  over  a  decade,  era  does 
not  independently  test  disinfectants  before  registering  them  and  lacks 
criteria  to  assess  the  validity  of  registrant-proposed  test  methods  and 
modifications.  Second,  era  has  made  little  progress  in  resolving  these 
controversies  because  of  budget  constraints  and  inadequate  research 
management.  Third,  era  lacks  sufficient  internal  controls  to  ensure  the 
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quality  and  integrity  of  the  data  that  registrants  submit  on  disinfectant 
efficacy.  Fourth,  epa  lacks  an  enforcement  strategy  to  ensure  that,  once 
registered,  disinfectants  sold  and  distributed  in  the  marketplace  work  as 
claimed. 

The  extent  to  which  ineffective  disinfectants  are  marketed  is  unknown. 
Although  the  scientific  controversies  cloud  the  issue  somewhat,  evi¬ 
dence  from  ERA,  the  states,  and  others  suggests  that  up  to  20  percent  of 
disinfectants  on  the  market  may  be  ineffective. 


Principal  Findings 


Validity  of  Test  Methods  assurance  that  the  test  methods  and  performance  standards 

^  used  by  registrants  to  substantiate  disinfectant  efficacy  claims  are 

valid.  EPA  primarily  relies  on  standard-setting  organizations,  such  as  the 
Association  of  Official  Analytical  Chemists  (aoac)  and  the  industry  itself 
to  develop  test  methods  and  performance  standards.  However,  these 
methods  and  standards  have  been  embroiled  in  scientific  controversies 
for  over  a  decade.  For  example,  scientists  have  debated  whether  the 
AOAC  Use-Dilution  Method,  the  most  widely  used  test  method,  is  repro¬ 
ducible,  accurate,  and  precise,  and  whether  the  performance  standard 
(pass/fail  criterion)  established  by  epa  is  valid.  Although  era  believes 
that  the  existing  methods  and  standards  are  acceptable  for  registering 
and  enforcing  disinfectant  efficacy  claims,  the  controversies  have 
impaired  the  credibility  of  the  disinfectant  program.  An  ad  hoc 
industry /state  group  recently  has  developed  a  test  method  to  replace 
the  AOAC  Use-Dilution  Method  and  is  expected  to  present  the  results  of 
its  research  to  the  aoac  in  September  1990.  era  officials  believe  that  the 
new  method  is  reproducible  and  reliable  and  will  consider  whether  to 
require  that  disinfectants  be  retested  using  it  after  aoac  considers  it  for 
adoption. 

era  has  contributed  to  the  controversies  by  accepting  test  methods  and 
modifications  without  criteria  and  independent  laboratory  data  for  eval¬ 
uating  their  validity.  For  example,  era  accepts  three  different  test 
methods  to  demonstrate  that  disinfectants  kill  tuberculosis  bacteria.  At 
least  one  product  tested  under  two  of  the  methods  produced  substan¬ 
tially  different  results.  Although  era  has  registered  the  product  on  the 
basis  of  one  of  the  methods,  era  lacks  the  laboratory  information  needed 
to  explain  the  differences  in  results  between  the  methods. 
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Although  EPA  has  been  aware  of  the  scientific  controversies  for  years,  it 
has  made  little  progress  in  resolving  them  because  of  problems  in  con¬ 
ducting  needed  research,  era’s  6-year,  $384,000,  cooperative  agreements 
with  the  University  of  North  Carolina  did  not  fulfill  epa’s  research 
objectives  to  improve  disinfectant  efficacy  methods  because  era  inade¬ 
quately  managed  the  agreements,  era  has  also  made  little  progress  in 
conducting  additional  research  because  of  budget  constraints.  In  April 
1990,  ERA  announced  that  it  would  spend  $600,000  for  research  on  cer¬ 
tain  disinfectant  efficacy  methods  and  estimated  an  additional  $1.2  mil¬ 
lion  will  be  needed. 


Controls  Over  Quality  and 
Integrity  of  Data 


To  ensure  the  quality  and  integrity  of  registrant-submitted  disinfectant 
data,  ERA  reviews  the  data  prior  to  registration  and  performs  laboratory 
inspections  and  data  audits.  GAO,  however,  found  internal  control  weak¬ 
nesses  in  these  programs.  For  example,  era  has  not  inspected  the 
majority  of  labs  that  have  performed  disinfectant  efficacy  studies.  In 
fact,  ERA  was  aware  of  only  12  of  the  92  labs  that  had  performed  these 
studies.  Although  these  programs  need  to  be  improved  they,  in  them¬ 
selves,  are  not  an  adequate  substitute  for  a  preregistration  program  to 
selectively  test  disinfectant  efficacy  by  an  independent  laboratory.  Data 
reviewers,  lab  inspectors,  and  data  auditors  generally  cannot  identify 
cases  in  which  registrants  have  selectively  submitted  data  indicating 
that  their  disinfectants  work  because  they  generally  do  not  observe  the 
tests  in  progress  and  no  physical  evidence  remains  from  the  tests 
conducted. 


Monitoring  and 
Enforcement  of  Marketed 
Disinfectants 


era’s  registration  process  by  itself  cannot  provide  assurance  that  disin¬ 
fectants  are  effective  because  registrants  could  market  ineffective 
batches,  either  intentionally  or  inadvertently,  after  registering  them. 
However,  era  does  not  enforce  the  efficacy  claims  of  disinfectants  on  the 
market,  era  discontinued  its  limited  enforcement  testing  program  in 
1982  primarily  because  of  budget  constraints.  Since  1982,  era  has 
looked  to  the  states,  user  groups,  and  the  industry  to  enforce  efficacy 
claims.  However,  gao  found  few  states  and  no  users  monitoring  disinfec¬ 
tant  efficacy  because  of  cost  concerns.  Only  five  states  test  disinfectants 
for  efficacy,  and  these  states  have  limited  programs.  Moreover,  era 
lacks  a  strategy  to  channel  complaints  about  potentially  ineffective  dis¬ 
infectants  from  the  states,  user  groups,  and  the  industry  and  to  take 
appropriate  enforcement  action  against  disinfectants  found  to  be  inef¬ 
fective.  Although  ERA  needs  to  resolve  the  scientific  controversies  that 
surround  disinfectant  efficacy  test  methods  and  performance  standards. 
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these  controversies  should  not  prevent  epa  from  developing  an  enforce¬ 
ment  strategy,  in  coiyimction  with  the  states,  user  groups  and  industry, 
to  ensure  that  marketed  disinfectants  work  as  claimed.  Public  health 
and  consumer  welfare  may  be  compromised  without  such  assurance. 


Recommendations 


GAO  is  making  recommendations  to  the  Administrator,  era,  to  correct 
deficiencies  and  restore  credibility  in  the  disinfectant  program, 
including  (1)  developing  a  plan  to  resolve  the  scientific  controversies 
that  surround  disinfectant  efficacy  test  methods  and  performance  stan¬ 
dards;  (2)  developing  and  publishing  a  policy  that  establishes  criteria 
for  evaluating  the  validity  of  new  test  methods  and  modifications, 
including  criteria  for  determining  when  independent  laboratory  data  are 
needed  for  validation;  (3)  improving  internal  controls  over  its  current 
programs  to  ensure  the  quality  and  integrity  of  registrant-submitted 
efficacy  data  and  conducting  preregistration  tests  to  selectively  verify 
registrant  claims;  (4)  establishing  an  enforcement  strategy  in  conjunc¬ 
tion  with  the  states,  user  groups,  and  industry  to  ensure  that  marketed 
disinfectants  work  as  claimed;  and  (5)  preparing  a  cost-benefit  analysis 
of  alternatives  for  a  laboratory  facility  to  research  and  test  the  efficacy 
of  disinfectants,  including  the  option  of  charging  fees  to  register  disin¬ 
fectants  to  help  finance  such  a  facility. 


Agency  Comments 


GAO  did  not  obtain  official  agency  comments  on  this  report,  gao  did, 
however,  discuss  the  factual  content  of  the  report  with  epa  officials  and 
has  included  their  comments  where  appropriate,  era  officials  generally 
agreed  with  the  accuracy  of  the  facts  but  believed  that,  as  presented, 
the  report  could  be  misread  and  suggested  changes  for  presenting  the 
facts.  GAO  made  some  revisions  to  the  report  on  the  basis  of  era’s  com¬ 
ments.  GAO  believes  that  the  report  is  a  fair  and  accurate  presentation  of 
the  issues. 
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Introduction 


Disinfectants'  are  used  almost  everywhere  people  want  to  kill  disease- 
causing  microorganisms — in  households,  hospitals,  schools,  restaurants, 
day  care  centers,  dairy  farms,  and  a  host  of  other  places.  About  $1  bil¬ 
lion  a  year  is  spent  on  disinfectants  to  kill  bacteria,  fungi,  and  viruses  in 
bathrooms,  kitchens,  and  offices;  on  medical  and  dental  instruments, 
diaper  pails,  and  eating  utensils;  and  at  many  other  locations.  Although 
the  role  of  the  inanimate  environment  in  transmitting  infections  has  not 
been  completely  defined,  the  use  of  disinfectants  is  considered  an  impor¬ 
tant  part  of  infection  control  programs.  In  fact,  health-care  organiza¬ 
tions  recommend,  and  many  public  health  ordinances  require,  their  use. 


The  Environmental  Protection  Agency  (epa)  regulates  disinfectants  as 
pesticides  under  the  Federal  Insecticide,  Fungicide,  and  Rodenticide  Act, 
as  amended  (fifra).^  Under  fifra,  disinfectants  generally  must  be  regis¬ 
tered  (licensed)  by  epa  before  they  may  be  sold,  held  for  sale,  or  distrib¬ 
uted  in  commerce,  epa  may  register  a  disinfectant  only  if  era  determines 
that  it  is  effective,  when  used  as  directed,  without  causing  an  unreason¬ 
able  risk  to  public  health  or  the  environment,  era  requires  disinfectant 
firms  to  submit,  among  other  things,  data  demonstrating  that  their  prod¬ 
ucts  are  effective  as  claimed  before  era  will  register  them.  As  of  Sep¬ 
tember  1, 1989,  about  4,100  disinfectants  were  registered  with  era. 
These  disinfectants  represented  about  18  percent  of  approximately 
23,000  registered  pesticide  products. 

As  permitted  under  fifra,  era  has  waived  all  requirements  for  pesticide 
firms  to  submit  efficacy  data  except  for  (1)  disinfectants  and  (2)  pesti¬ 
cides  that  claim  to  control  vertebrates  that  may  transmit  diseases  to 
humans,  such  as  rodents,  birds,  and  skunks,  era  retains  the  requirement 
for  disinfectants  because  users  cannot  see  whether  disinfectants  kill 
microorganisms  that  may  cause  human  disease,  such  as  the  bacteria  that 
cause  food  poisoning,  and  because  the  use  of  an  ineffective  disinfectant 


Federal  Regulation  of 
Disinfectants 


'As  defined  by  EPA,  “disinfectant”  refers  to  only  one  of  several  types  of  antimicrobial  pesticides, 
which,  with  some  exceptions,  are  substances  intended  to  inhibit  or  destroy  microorganisms  (bacteria, 
fungi,  viruses,  and  spores).  However,  we  use  the  term  “disinfectant”  in  this  report  to  broadly  describe 
all  antimicrobial  pesticides  intended  to  protect  public  health.  For  explanations  of  specific  disinfectant 
efficacy  claims,  see  table  1.1  and  the  glossary. 


^Disinfectants,  which  are  used  on  inanimate  surfaces,  are  distinct  from  antiseptics,  which  are  used  on 
skin  and  other  living  tissue.  Antiseptics  are  regulated  by  the  Food  and  Drug  Administration.  Disinfec¬ 
tants  that  are  used  in  or  on  medical  devices,  such  as  dialysis  machines,  are  regulated  by  both  EPA  and 
the  Food  and  Drug  Administration. 
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poses  a  threat  to  public  health.  By  contrast,  epa  does  not  require  regis¬ 
trants  to  submit  efficacy  data  for  other  pesticides  because  users  gener¬ 
ally  can  tell  whether  they  work,  and  the  marketplace  can  regulate 
product  performance.  In  addition,  registrants  of  pesticides  that  target 
microorganisms  that  do  not  cause  diseases  in  humans,  such  as  those  that 
target  slime-forming  or  odor-causing  bacteria,  are  not  required  to  submit 
efficacy  data,  era  does,  however,  require  all  registrants  to  be  able  to 
show  that  their  products  are  effective  on  demand  for  such  data. 

EPA’s  Office  of  Pesticides  and  Toxic  Substances  (opts)  is  responsible  for 
regulating  pesticides,  including  disinfectants.  Within  opts,  the  Office  of 
Pesticide  Programs  (opp)  and  the  Office  of  Compliance  Monitoring  (ocm) 
are  responsible  for  evaluating  pesticides  for  registration  and  for  plan¬ 
ning  and  coordinating  pesticide  compliance/enforcement  activities, 
respectively.  The  Antimicrobial  Program  Branch  (formerly  the  Disinfec¬ 
tants  Branch),  within  OPP,  is  responsible  for  registering  disinfectants. 
Within  the  branch,  the  Efficacy  Evaluation  and  Technical  Management 
Section  is  responsible  for  approving  and  recommending  methods  for 
testing  the  efficacy  of  disinfectants  and  evaluating  registrant-submitted 
efficacy  data. 


Disinfectant  Types 
and  Uses 


ERA  registers  disinfectants  with  a  variety  of  efficacy  claims  for  use  in 
many  areas  of  the  inanimate  environment.  Disinfectant  types  and  uses 
range  from  products  intended  to  kill  bacteria  on  hard  surfaces  in  bath¬ 
rooms  to  products  intended  to  chemically  sterilize  medical  instruments 
in  hospitals. 

A  disinfectant  may  claim  one  or  more  of  a  number  of  types  of  efficacy. 
The  types  of  efficacy  claims  a  disinfectant  may  make  depend  on,  among 
other  things,  the  types  of  microorganisms  the  disinfectant  targets  (e.g., 
tuberculosis  or  a  polio  virus)  and  the  disinfectant’s  intended  level  of 
activity  (e.g.,  a  reduction  in  the  level  of  the  microorganism  or  a  complete 
kill).  (For  a  list  of  selected  disinfectant  efficacy  claims,  see  table  1.1.) 
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Table  1.1:  Selected  Disinfectant  Efficacy 
Claims 


Sterilizer 

The  disinfectant,  sometimes  called  a  sporicide,  is  intended  to 
destroy  or  eliminate  viruses  and  all  living  bacteria,  fungi,  and  their 
spores.  (The  claim  denotes  killing  all  microorganisms,  including  the 
highly  resistant  spore  forms,  and  indicates  that  the  disinfectant  will 
produce  the  highest  level  of  disinfection  possible.) 

Tuberculocide 

The  disinfectant  is  intended  to  destroy  or  inactivate  tuberculosis 
bacteria.  (Tuberculocidal  claims  are  often  used  by  medical  users  of 
disinfectants  as  an  indicator  of  product  strength  because 
tuberculosis  bacteria  are  more  difficult  to  kill  than  most  other 
species  of  bacteria.) 

Disinfectant 

The  disinfectant  is  intended  to  destroy  or  inactivate  one  or  more 
major  species  of  bacteria,  depending  upon  whether  the  disinfectant 
makes  a  "limited,"  "general,"  or  "hospital"  disinfectant  claim. 

Fungicide 

The  disinfectant  is  intended  to  destroy  fungi. 

Virucide 

The  disinfectant  is  intended  to  destroy  or  inactivate  one  or  more 
specific  viruses  named  on  the  disinfectant’s  label. 

Sanitizer 

The  disinfectant  is  intended  to  reduce  the  number  of  living  bacteria 
or  viable  virus  particles. 

Source:  Prepared  by  GAO  on  the  basis  of  EPA  disinfectant  efficacy  data  requirements  and  the  definition 
of  disinfectant  from  footnote  1 . 


We  used  epa’s  Pesticide  Product  Information  System  (ppis)  to  obtain 
epa’s  best  available  data  on  registered  disinfectant  claims.  According  to 
the  system,  about  4,100  disinfectants^  were  registered  with  epa  as  of 
September  1, 1989.'*  These  disinfectants  made  about  8,000  different  effi¬ 
cacy  claims  or,  on  average,  about  2  claims  per  disinfectant.  The  most 
common  efficacy  claim  was  “disinfectant.”  (See  fig.  1.1.) 


registers  both  end-use  products  (products  for  sale  at  the  retail  level)  and  manufacturing-use 
products  (active  ingredients  for  use  in  end-use  products).  Because  EPA  requires  a  complete  efficacy 
profile  only  on  end-use  products,  we  did  not  include  manufacturing-use  products  in  oim  counts  of 
disinfectants. 


‘‘The  1988  amendments  to  FIFRA  imposed  user  fees  on  pesticide  registrants  to  help  fund  an  acceler¬ 
ated  review  of  older  pesticides  and  expedited  registration  of  new  pesticides.  In  1989,  EPA  canceled 
over  6,000  disinfectant  registrations  because  registrants  decided  to  abandon  their  registrations  rather 
than  pay  the  required  fees. 
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Figure  1.1:  Registered  Disinfectant 
Efficacy  Claims  by  Type 


Water  purifier  claims  were  not  included  because  they  represented  less  than  1  percent  of  all 
registered  disinfectant  efficacy  claims  as  of  September  1 , 1989. 

Source:  Prepared  by  GAO  on  the  basis  of  data  from  the  EPA  Pesticide  Product  Information  System. 

In  addition  to  the  types  of  efficacy  claimed  (e.g.,  tuberculocidal),  each 
registered  disinfectant  must  specify  the  use  patterns  for  which  the  dis¬ 
infectant  is  recommended.  Broad  categories  of  use  patterns  include  the 
use  of  a  disinfectant  (1)  to  kill  microorganisms  on  hard  surfaces,  (2)  to 
kill  microorganisms  on  fabrics  or  textiles,  (3)  to  control  microbial  pests 
associated  with  hiunan  or  animal  wastes,  and  (4)  to  treat  water  systems. 
Registrants  typically  label  their  disinfectants  for  use  at  specific  sites 
within  these  broad  categories.  For  example,  a  disinfectant  intended  for 
use  on  hard  surfaces  may  be  labeled  for  use  on  counter  tops,  medical 
instruments,  floors,  or  other  types  of  hard  surfaces. 

According  to  ppis,  as  of  September  1, 1989,  the  approximately  4,100  dis¬ 
infectants  made  about  18,100  specific  use  site  claims.  About  76  percent 
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of  the  disinfectants,  or  3,200,  were  registered  for  use  on  at  least  1  hard 
surface  site.  Some  of  the  common  hard  surfaces  for  which  disinfectants 
were  registered  were  the  surfaces  in  bathrooms,  hospitals,  and  eating 
establishments,  and  at  commercial/industrial  sites. 

EPA  has  limited  data  on  the  size  of  the  disinfectant  market.  However, 
data  from  a  private  market  research  firm  indicates  that  the  disinfectant 
market  is  about  $1  billion  per  year  at  the  retail  level  in  the  United 
States.  In  addition,  as  table  1.2  illustrates,  the  estimated  average  annual 
amount  of  disinfectants  sold  represented  a  substantial  amount  of  all 
pesticides  sold  in  the  United  States  during  1985-87. 


Table  1.2:  Estimated  Average  Annual 
Amount  of  Disinfectants  Sold  in  the 
United  States,  1985-87 


Pounds  and  gallons  in  thousands 

Amount  sold 

Dry  or  solid 
chemical 
product  (lbs.) 

Percentage  of 
dry  or  solid 
chemical 
pesticides 

Liquid 
chemical 
product  (gal.) 

Percentage 
of  liquid 
chemical 
pesticides 

Pesticides 

8,773,799 

100 

1,067,308 

100 

Disinfectants 

1,182,203 

13 

542,606 

51 

Disinfectants  used 
on  hard  surfaces 

486,207 

6 

493,159 

46 

Source:  Prepared  by  GAO  on  the  basis  of  data  from  the  PPIS  and  the  FIFRA  and  Toxic  Substances 
Control  Act  Enforcement  System. 


Overview  of  Efficacy 
Data  Requirements 


EPA  requires  the  manufacturer  or  registrant  to  develop  and  submit  data 
on  a  disinfectant  for  each  claim  and  use  of  the  product,  epa  has  pub¬ 
lished  guidelines  that  recommend  specific  methods  and  minimum  test 
specifications  for  registrants  to  use  to  test  the  efficacy  of  disinfectants. 
The  guidelines  also  contain  performance  standards  (pass/fail  criteria) 
that  disinfectants  must  meet  to  make  efficacy  claims. 


Description  of  Test 
Methods 


epa’s  Pesticide  Assessment  Guidelines  and  supplemental  technical  gui¬ 
dance  briefs  contain  recommended  methods  for  testing  disinfectants, 
standards  for  conducting  acceptable  tests,  and  instructions  on  inter¬ 
preting  and  reporting  data.  Table  1.3  lists  the  EPA-recommended 
methods  for  demonstrating  specific  efficacy  claims  of  disinfectants  used 
on  hard  surfaces. 
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Table  1  3-  EPA-Recommended  Methods  for  Testing  Disinfectants  Intended  for  Use  on  Hard  Surfaces 

Type  of  claim 

EPA-recommended  method(s) 

Test  organism(s) 

Sterilizer 

AOAC  Sporicidal  Test 

Bacilius  subtilis  and  Clostridium  sporogenes 

Tubercuiocide 

AOAC  Tuberculocidal  Activity  Method 

Mycobacterium  tuberculosis 

Modified  AOAC  Tuberculocidal  Activity 
Method 

Quantitative  Tuberculocidal  Activity  Test 
Method 

Hospital  disinfectant 

AOAC  Use-Diiution  Method 

AOAC  Germicidal  Spray  Products  Test 

Salmonella  choleraesuis,  Staphylococcus 
aureus,  and  Pseudomonas  aeruginosa 

Generai  disinfectant 

AOAC  Use-Dilution  Method 

Saimonella  choieraesuis  and  Staphylococcus 
aureus 

AOAC  Germicidal  Spray  Products  Test 

Limited  disinfectant 

AOAC  Use-Dilution  Method 

Salmonella  choleraesuis  or  Staphylococcus 
aureus 

AOAC  Germicidai  Spray  Products  Test 

Fungicide 

AOAC  Fungicidal  Test 

Trichophyton  mentagrophytes 

AOAC  Use-Dilution  Method 

AOAC  Germicidai  Spray  Products  Test 

Virucide 

EPA  virucidai  test  parameters 

Specific  virus  claimed 

Sanitizing  rinse  (food-contact  surfaces) 

AOAC  Avaiiabie  Chlorine  Germicidal 
Equivalent  Concentration  Method 

Escherichia  coii;  and  Salmonelia  typhi  or 
Staphylococcus  aureus 

AOAC  Germicidal  and  Detergent  Sanitizers 
Method 

Sanitizer  (inanimate,  nonfood-contact 
surfaces) 

EPA  sanitizer  test  parameters 

Staphylococcus  aureus;  and  Klebsiella 
pneumoniae  aberrant  or  Enterobacter 
aerogenes 

Source:  Prepared  by  GAO  on  the  basis  of  EPA's  Pesticide  Assessment  Guidelines. 


Most  of  the  EPA-recommended  methods  were  developed  under  the  aus¬ 
pices  of  the  Association  of  Official  Analytical  Chemists  (aoac),  an  inde¬ 
pendent,  international  standard-setting  organization,  aoac’s  primary 
purpose  is  to  develop  and  validate  standardized  chemical  and  biological 
analytical  methods  that  will  perform  with  the  necessary  accuracy  and 
precision  under  usual  laboratory  conditions  to  be  recognized  as  “offi¬ 
cial”  methods  by  the  courts  and  others.  According  to  the  aoac  Assistant 
Executive  Director,  a  collaborative  study,  or  round  robin  test,  is  con¬ 
ducted  for  each  method  to  provide  an  unbiased  evaluation  of  the  per¬ 
formance  of  an  analytical  method  through  the  analysis  of  a  number  of 
identical  samples  by  a  number  of  different  laboratories. 
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In  evaluating  registrant-submitted  efficacy  data  on  disinfectants,  epa 
determines  whether  the  data  are  adequate  to  satisfy  its  data  require¬ 
ments  and  guidelines.  This  determination  involves  considering  the 
design  and  conduct  of  the  test,  including  whether  generally  accepted 
methods  were  used,  whether  a  sufficient  number  of  measurements  were 
made  to  achieve  statistical  reliability,  whether  sufficient  controls  were 
built  into  the  test,  whether  the  test  was  conducted  in  conformity  with 
the  design,  whether  good  laboratory  practices  were  observed,  and 
whether  the  results  were  reproducible. 


Description  of  Pesticide  Assessment  Guidelines  also  contain  performance  stan- 

Performance  Standards  dards  that  era  requires  disinfectant  products  to  meet  to  make  specific 

efficacy  claims.  Failure  of  a  product  to  meet  the  specified  testing  or  per¬ 
formance  requirements  is  considered  evidence  that  the  product  is 
unlikely  to  be  effective  as  claimed  in  actual  use. 

The  performance  standards  vary  depending  on  the  claim  intended  and 
the  test  method  employed.  For  example,  for  a  hospital  disinfectant,  epa 
recommends  that  three  batches  be  tested  using  the  aoac  Use-Dilution 
Method  against  three  different  microorganisms  using  60  test  tubes  per 
microorganism  per  batch.  If  the  product  fails  to  kill  a  microorganism  in 
2  or  more  out  of  the  60  tubes  for  any  microorganism/batch,  then  the 
product  is  considered  to  have  failed  the  test  for  the  specific  microor¬ 
ganism  tested. 


Disinfectants  and 
Infection  Control 


Although  the  role  of  the  inanimate  environment  in  transmitting  infec¬ 
tions  has  not  been  completely  defined,  doctors,  dentists,  restaurant 
owners,  consumers,  and  others  consider  disinfectants  to  play  an  impor¬ 
tant  part  in  infection  control.  Health-care  providers,  as  well  as  others, 
rely  on  era’s  registration  of  disinfectants  as  evidence  that  purchased 
products  work  as  claimed. 

Infection  control  is  a  serious  concern  for  health-care  providers. 
According  to  the  Centers  for  Disease  Control  (cdc),  about  6  percent  of  all 
patients  acquire  an  infection  while  hospitalized.  Hospital-acquired,  or 
nosocomial,  infections  prolong  hospital  stays,  increase  patient  care 
costs,  and,  in  some  cases,  cause  death.  According  to  one  estimate. 
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nosocomial  infections  may  cause  approximately  20,000  deaths  and  con¬ 
tribute  to  about  60,000  more  deaths  annually. ^  Furthermore,  according 
to  one  infection  control  expert,  nosocomial  infections  rank  among  the  10 
most  frequent  causes  of  death  in  the  United  States.®  In  addition,  interest 
in  disinfectant  efficacy  has  increased  in  response  to  the  growing  num¬ 
bers  of  immune  deficient  patients,  who  are  susceptible  to  infections. 

Although  medical  experts  generally  believe  that  most  nosocomial  infec¬ 
tions  are  transmitted  from  person  to  person  rather  than  from  the  inani¬ 
mate  environment,  the  role  of  the  inanimate  environment  in 
transmitting  infections  has  not  been  completely  defined.  Research  has 
linked  at  least  some  infections,  including  fatalities,  to  contaminated 
endoscopes  and  other  medical  instruments,  but  their  exact  contribution 
to  the  overall  nosocomial  infection  rate  is  unknown.  In  addition,  contro¬ 
versy  exists  over  the  extent  to  which  inanimate  objects  (e.g.,  stetho¬ 
scopes)  and  environmental  surfaces  (e.g.,  floors,  walls,  sink  drains)  that 
come  into  contact  with  intact  skin  can  transmit  infections.  Lastly,  many 
infections  from  inanimate  objects  may  never  be  detected  because  so 
much  time  can  elapse  between  infection  and  the  onset  of  illness  that  the 
source  of  the  infection  is  difficult  to  trace. 

Health-care  providers  generally  use  disinfectants  to  treat  medical 
instruments  they  cannot  otherwise  sterilize  or  dispose  of.  For  example, 
disinfectants  are  used  on  sensitive  medical  instruments,  such  as  fiber¬ 
optic  endoscopes,  that  cannot  be  sterilized  using  heat  and  on  instru¬ 
ments  that  need  to  be  sterilized  quickly  between  uses.  In  addition,  many 
health-care  providers  view  the  use  of  disinfectants  on  objects/surfaces 
that  come  into  contact  with  intact  skin  as  a  necessary  part  of  infection 
control,  in  the  absence  of  evidence  that  these  objects/surfaces  play  a 
negligible  role  in  transmitting  infections. 

Infection  control  also  is  a  serious  concern  in  the  food-processing  and 
food-service  industries,  since  food  can  be  easily  contaminated  by  dis¬ 
ease.  The  total  amount  of  food-bome  illness  in  the  United  States  is 
unknown,  but  outbreaks  occur  frequently.  Both  industries  use  sanitizers 
on  food-contact  surfaces  (e.g.,  food-processing  equipment  and  utensils) 
to  reduce  the  likelihood  that  food  may  become  contaminated. 


®  James  M.  Hughes  and  WUliam  R.  Jarvis,  “Epidemiology  of  Nosocomial  Infections,”  in  Manual  of 
Clinical  Microbiology,  4th  ed.,  ed.  Edwin  H.  Lennett  et  al.  (Washington,  D.C.:  American  Society  for 
Microbiology,  1985). 


^Robert  W.  Haley,  Managing  Hospital  Infection  Control  for  Cost-Effectiveness  (Chicago:  American 
Hospital  Publishing,  Inc.,  1986). 
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Prior  GAO  Reports 


Objectives,  Scope,  and 
Methodology 


We  have  issued  two  reports  in  the  past  addressing  the  need  to  better 
regulate  the  efficacy  of  disinfectants.  In  1968,  we  reported  that  many 
pesticides  subject  to  enforcement-seizure  action,  including  some  disinfec¬ 
tants  that  the  federal  government  found  to  be  ineffective,  may  have 
remained  on  the  market.’’  In  1974,  we  questioned  era’s  reliance  on  regis¬ 
trant-submitted  data  for  registering  pesticides  with  high  rates  of  effi¬ 
cacy  failures,  such  as  disinfectants.  We  also  found  that  era  did  not 
always  cancel  disinfectant  registrations  or  require  registrants  to  delete 
efficacy  claims  from  the  labels  of  repeatedly  ineffective  disinfectants.® 


In  a  January  27, 1989,  letter,  and  at  subsequent  meetings  with  their 
staffs,  the  Chairman  and  Ranking  Minority  Member  of  the  House  Com¬ 
mittee  on  Government  Operations,  and  the  Chairman  and  Ranking 
Minority  Member  of  the  Environment,  Energy  and  Natural  Resources 
Subcommittee,  House  Committee  on  Government  Operations,  asked  us  to 
review  era’s  efforts  to  regulate  the  efficacy  of  disinfectants.  In  partic¬ 
ular,  the  Committee  and  Subcommittee  agreed  that  we  would  address 
the  following  questions: 

What  is  the  nature  of  the  scientific  controversies  surrounding  ERA-rec- 
ommended  methods  for  testing  the  efficacy  of  disinfectants? 

What  action  has  era  taken  to  obtain  objective  research  to  resolve  the 
scientific  controversies  that  surround  disinfectant  efficacy  test  methods 
and  performance  standards? 

Does  ERA  have  sufficient  internal  controls  to  ensure  the  quality  and 
integrity  of  registrant-submitted  disinfectant  efficacy  data? 

What  post-registration  enforcement  procedures  have  era  and  the  states 
implemented  to  ensure  that  disinfectants  on  the  market  are  effective? 
Does  a  need  exist  for  a  post-registration  program  to  monitor  disinfec¬ 
tants  on  the  market  and,  if  so,  what  options  exist  for  structuring  such  a 
program? 

ERA  believes  that  all  disinfectants  are  critical  to  protecting  public  health. 
However,  we  decided  to  concentrate  our  review  on  era’s  regulation  of 
the  efficacy  of  disinfectants  registered  for  use  on  hard  surfaces  because 
over  75  percent  of  all  disinfectants  were  registered  for  use  on  at  least 
one  hard-surface  use  site.  In  addition,  these  disinfectants  are  most 


’^Need  to  Improve  Regulatory  Enforcement  Procedures  Involving  Pesticides  (B-133192,  Sept.  10, 
1968). 

^Pesticides:  Actions  Needed  to  Protect  the  Consumer  From  Defective  Products  (B-133192,  May  23, 
1974). 


Page  16 


6AO/RCED-90-139  ERA  Lacks  Assurance  Disinfectants  Work 


Chapter  1 
Introduction 


affected  by  the  scientific  controversies  surrounding  the  test  methods 
used  to  substantiate  efficacy. 

To  understand  era’s  efficacy  data  requirements  and  determine  the 
nature  of  the  scientific  controversies  surrounding  EPA-recommended 
methods  for  testing  disinfectant  efficacy  (see  ch.  2),  we  (1)  reviewed, 
and  interviewed  era  officials  about,  era’s  disinfectant  efficacy  data 
requirements  and  procedures  for  accepting  test  methods,  procedures, 
and  modifications;  (2)  observed  microbiologists  at  two  state  laboratories 
perform  efficacy  tests;  (3)  interviewed  sources  knowledgeable  about  the 
test  methods  and  controversies,  including  individuals  affiliated  with 
federal  and  state  agencies,  standard-setting  organizations,  professional 
and  trade  associations,  scientific  associations,  universities,  and  commer¬ 
cial  laboratories  (see  app.  I);  (4)  attended  several  conferences  and  meet¬ 
ings  held  by  the  aqac,  the  standard-setting  organization  whose  methods 
are  the  subject  of  scientific  controversy,  and  discussed  disinfectant  effi¬ 
cacy  test  methods  and  related  issues  with  participants;  and  (5)  reviewed 
scientific  and  medical  literature  on  disinfectant  efficacy  and  efficacy 
test  methods. 

To  determine  what  steps  era  has  taken  to  obtain  objective  research  to 
resolve  the  controversies  (see  ch.  2),  we  (1)  interviewed  the  era  grant, 
project,  and  quality  assurance  officers  responsible  for  managing  and 
overseeing  era’s  cooperative  agreements  on  efficacy  test  research  with 
the  University  of  North  Carolina  at  Chapel  Hill  (unc);  officials  within 
the  ERA  Antimicrobial  Program  Branch;  and  the  two  lead  unc  researchers 
and  the  statistician  participating  in  the  cooperative  agreements;  (2) 
reviewed  era  financial  assistance  agreement  regulations,  policies,  and 
procedures;  (3)  reviewed  era  grant  and  project  officer  files  and  unc 
records,  including  financial  statements,  progress  reports,  and  technical 
reports;  (4)  interviewed  individuals  outside  era  about  the  research  per¬ 
formed  imder  the  agreements;  and  (5)  reviewed  era’s  Jime  1987  strategy 
paper  on  improving  its  disinfectant  program  and  updates  to  the 
strategy.  We  were  unable  to  determine  whether  era  had  obtained  objec¬ 
tive  research  because  era  inadequately  managed  the  cooperative 
agreements. 

To  determine  whether  era  has  sufficient  internal  controls  in  place  to 
ensure  the  quality  and  integrity  of  registrtmt-submitted  disinfectant 
efficacy  data  (see  ch.  3),  we  (1)  reviewed  the  Federal  Managers’  Finan¬ 
cial  Integrity  Act  of  1982  (fmfia)  and  federal  guidelines  on  internal  con¬ 
trols,  (2)  reviewed  era’s  1983  through  1989  annual  internal  control 


Page  17 


GAO/ECED-90-139  EPA  Lacks  Assurance  Disinfectants  Work 


Chapter  1 
Introduction 


reports  and  other  epa  documents  on  epa’s  internal  controls,  (3)  inter¬ 
viewed  EPA  officials  to  determine  what  procedures  epa  has  implemented 
to  ensure  the  quality  and  integrity  of  the  efficacy  data  that  registrants 
submit  and  whether  the  procedures  are  effective,  and  (4)  reviewed  files 
from  epa  inspections/audits  over  about  a  4-year  period  at  laboratories 
that  have  conducted  disinfectant  efficacy  studies. 

To  determine  what  post-registration  procedures  epa  and  the  states  had 
implemented  to  ensure  that  disinfectants  on  the  market  are  effective 
(see  ch.  4),  we  (1)  visited  and/or  interviewed  officials  from  states  that 
monitor  the  efficacy  of  marketed  disinfectants  and  obtained  available 
testing  and  enforcement  data;  (2)  interviewed  several  officials  repre¬ 
senting  states  that  do  not  test  disinfectants  to  determine  why;  (3)  visited 
epa’s  disinfectant  laboratory  facility  in  Beltsville,  Maryland  and 
reviewed  existing  records  from  the  testing  program  maintained  at  the 
lab;  and  (4)  interviewed  era.  officials  about  era’s  decision  to  discontinue 
a  limited  program  to  test  disinfectants  for  efficacy.  To  determine  which 
states  monitor  the  efficacy  of  marketed  disinfectants,  we  relied  prima¬ 
rily  on  EPA  to  survey  the  states  through  the  era  regional  pesticide  branch 
chiefs. 

To  determine  whether  a  need  exists  for  a  post-registration  program  to 
monitor  disinfectants  on  the  market  and  what  options  exist  for  struc¬ 
turing  such  a  program  (see  ch.  5),  we  (1)  interviewed  individuals  within 
EPA,  the  disinfectants  industry,  the  health-care  community,  state  agen¬ 
cies,  and  academia;  (2)  reviewed  available  disinfectant  laboratory  cost 
estimates;  and  (3)  reviewed  the  history  of  legislative  proposals  to 
resume  a  disinfectant-testing  program  at  era’s  Beltsville  laboratory. 

To  identify  the  number  of  registered  disinfectant  products  and  claims 
and  the  amount  of  disinfectants  sold  in  the  United  States,  we  used  data 
from  era’s  Pesticide  Product  Information  System  and  fifra  and  Toxic 
Substances  Control  Act  (tsca)  Enforcement  System  (fifra  sec.  7  annual 
production  report  data).  To  identify  laboratories  that  conducted  disin¬ 
fectant  efficacy  studies  submitted  to  epa,  we  used  era’s  Pesticide  Docu¬ 
ment  Management  System.  (We  will  express  our  concerns  about  the 
accuracy  and  completeness  of  disinfectants  data  in  these  systems  in  a 
separate  letter  to  be  issued  shortly  to  the  Administrator,  era.) 

To  understand  the  role  of  disinfectants  in  preventing  disease  transmis¬ 
sion,  we  (1)  reviewed  medical  literature  on  disinfectants  and  infection 
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control,  (2)  interviewed  representatives  from  the  infection  control  com¬ 
munity  and  reviewed  their  infection  control  guidelines,  and  (3)  inter¬ 
viewed  infection  control  personnel  at  a  large  urban  teaching  hospital 
about  infection  control  procedures  and  watched  them  demonstrate  these 
procedures. 

We  did  not  (1)  attempt  to  resolve  the  scientific  controversies  about  dis¬ 
infectant  efficacy  test  methods  by  independently  analyzing  the  validity 
of  the  methods,  (2)  review  the  efficacy  of  any  individual  disinfectant  or 
class  of  disinfectants,  (3)  address  era’s  efforts  to  monitor  disinfectant 
efficacy  claims  made  in  product  advertising,  or  (4)  assess  era’s  knowl¬ 
edge  and  regulation  of  the  toxicity  of  disinfectants. 

Our  review  was  conducted  from  January  through  November  1989  and 
updated  with  information  gathered  through  June  1990  in  accordance 
with  generally  accepted  government  auditing  standards.  As  requested, 
we  did  not  obtain  official  agency  comments  on  this  report.  We  did,  how¬ 
ever,  discuss  the  factual  content  of  the  report  with  era  officials  and 
have  included  their  comments  where  appropriate,  era  officials  generally 
agreed  with  the  accuracy  of  the  facts,  but  believed  that  as  presented  the 
report  could  be  misread,  and  suggested  changes  for  presenting  them.  We 
made  some  revisions  to  the  report  on  the  basis  of  era’s  comments  and 
believe  that  the  report  is  a  fair  and  accurate  presentation  of  the  issues. 
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Doctors,  janitors,  consumers,  and  others  rely  on  era’s  review  and 
approval  of  registrant-submitted  data  for  assurance  that  disinfectants 
work  as  claimed.  However,  we  found  that  this  reliance  may  be 
unfounded  because  (1)  scientific  consensus  is  lacking  on  the  validity  of 
the  test  methods  and  standards  era  recommends  to  registrants  for  sub¬ 
stantiating  disinfectant  claims  and  (2)  era  lacks  criteria  for  assessing 
the  validity  of  registrant-proposed  test  methods  and  standards  and  does 
not  independently  validate  test  methods  before  permitting  their  use.  We 
question  whether  era  has  adequately  attempted  to  resolve  the  contro¬ 
versies.  ERA  inadequately  managed  the  limited  research  that  it  has 
funded  to  help  resolve  the  scientific  controversies,  and  the  research  has 
proved  to  be  controversial  itself.  Further,  era  has  made  limited  progress 
in  conducting  additional  research  to  resolve  the  controversies  because  of 
budget  constraints. 


Scientific  Controversy 
Over  Methods  and 
Standards 


era’s  regulations  require  that  pesticide  registration  test  methods  be  sta¬ 
tistically  reliable,  generally  acceptable,  and  reproducible.  However, 
almost  all  of  the  ERA-recommended  efficacy  test  methods  and  perform¬ 
ance  standards  for  the  approximately  3,200  disinfectants  used  on  hard 
surfaces  have  been  embroiled  in  scientific  controversy  for  over  a 
decade.  Various  scientists  and  officials  from  era,  state  governments, 
academia,  industry,  commercial  laboratories,  scientific  associations,  and 
user  groups  disagree  over  whether 


•  the  test  methods  contain  uncontrollable  variables  that  produce  inconsis¬ 
tent  and  nonreproducible  results, 

•  the  existing  laboratory  test  methods  adequately  simulate  performance 
of  a  disinfectant  in  actual  use,  and 

•  the  performance  standards  (pass/fail  criteria)  for  existing  methods  are 
valid  or  should  be  changed. 


Although  era  and  state  officials  acknowledge  that  the  existing  disinfec¬ 
tant  efficacy  methods  and  standards  may  need  to  be  improved,  era  and 
certain  state  officials  argue  that  the  existing  methods  and  standards 
have  not  been  invalidated,  are  the  only  available  methods/standards, 
and  are  acceptable  for  registration  and  enforcement  purposes. 

According  to  these  officials,  inconsistent  test  results  on  possibly  margin¬ 
ally  effective  and  ineffective  products  may  be  at  least  as  much  respon¬ 
sible  for  the  alleged  problems  with  disinfectant  efficacy  test  methods 
and  standards  as  the  methods  and  standards  themselves.  Further,  sev¬ 
eral  state  officials  and  others  believe  certain  registrants  and  others  have 
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raised  problems  with  the  methods  and  standards  to  divert  the  attention 
of  enforcement  review  from  products  that  are  possibly  ineffective. 

We  were  unable  to  disentangle  valid  criticisms  of  test  methods  and  per¬ 
formance  standards  from  possible  industry  self-interest  or  possible 
industry-funded  research  biases  because  of  the  mutually  dependent 
relationship  that  exists  between  researchers  and  industry,  epa  does  not 
believe  that  it  registers  ineffective  disinfectants.  However,  we  found 
that  the  validity  of  era’s  recommended  disinfectant  efficacy  methods 
and  standards  has  been  disputed  to  such  an  extent  that  the  credibility 
and  use  of  these  methods  and  standards  to  substantiate  disinfectant 
efficacy  claims  have  been  impaired. 


Variabilities  in  Test 
Methods  Alleged 


Methods  recommended  by  epa  for  testing  disinfectant  efficacy  have  been 
widely  criticized  by  industry,  academia,  and  others  for  producing  highly 
variable  results.  Researchers  disagree  over  the  extent  and  causes  of  the 
variability  and  over  how  the  methods  can  be  improved  or  replaced. 
Industry  and  other  critics  have  alleged  that  extreme  variability  inherent 
in  the  test  methods  and  laboratory  procedures  raise  doubts  about 
whether  the  test  results  can  be  repeated  within  the  same  lab  and 
whether  test  results  can  be  reproduced  by  different  labs.  Specific  con¬ 
troversies  related  to  test  variabilities  involve  questions  like  the  fol¬ 
lowing:  (1)  Does  the  design  of  the  methods  or  the  efficacy  of  products 
and  chemical  compounds  tested  account  for  inconsistent  results?  (2)  To 
what  extent  can  variability  in  laboratory  procedures,  operator  tech¬ 
nique  and  experience,  and  materials  used  be  controlled  or  reduced?  and 
(3)  Do  era’s  recommended  methods,  some  of  which  were  developed  over 
20  years  ago,  lack  the  necessary  accuracy  and  precision  expected  of  test 
methods  today? 

Most  criticisms  have  focused  on  the  aoac  Use-Dilution  Method  and  the 
aqac  Tuberculocidal  Activity  Method.  In  fact,  the  aoac  has  actively  con¬ 
sidered  repealing  the  two  test  methods  during  the  past  3  years  because 
of  reports  that  results  from  the  test  methods  could  not  be  consistently 
reproduced.'  However,  because  of  similarities  in  design,  concerns  about 
test  variabilities  in  the  aoac  Use-Dilution  and  Tuberculocidal  methods 


'The  aoac  repealed  the  Tuberculocidal  Activity  Method  at  its  general  meeting  in  September  1988. 
The  AQAC  Board  of  Directors  reinstated  the  method  in  March  1989,  following  an  objection  raised  by 
EPA  in  December  1988  that  the  AOAC  membership  voted  on  the  basis  of  erroneous  information 
presented  at  the  1988  meeting. 
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may  also  apply  to  other  disinfectant  efficacy  tests,  such  as  the  aoac 
Sporicidal  Test. 


Ability  of  Lab  Tests  to 
Simulate  Actual  Use 
Questioned 


Controversy  exists  over  the  extent  to  which  EPA-recommended  efficacy 
tests  should  and  do  simulate  actual  use  and  whether  they  provide  a  suf¬ 
ficient  margin  of  safety  to  allow  for  expected  variations  in  actual  use 
conditions,  era  has  generally  assumed  that  if  a  disinfectant  fails  to  per¬ 
form  as  claimed  under  the  recommended  efficacy  tests  conducted  in  a 
laboratory,  then  it  will  fail  to  perform  under  actual  use  conditions.  How¬ 
ever,  critics  from  industry,  academia,  and  other  organizations  claim  that 
the  laboratory  tests  may  not  accurately  predict  how  a  disinfectant  will 
perform  in  actual  use  because  the  surfaces,  number  and  resistance  of 
microorganisms,  presence  of  organic  matter  (e.g.,  blood),  disinfectant 
concentration,  ambient  temperature  at  which  a  disinfectant  is  used,  and 
amount  of  time  a  disinfectant  is  exposed  to  a  contaminated  surface 
(referred  to  as  “contact  time”),  among  other  things,  encountered  under 
actual  use  conditions  may  differ  significantly  from  laboratory  test  con¬ 
ditions.  In  fact,  some  infection  control  experts  have  advised  disinfectant 
users  to  extend  the  contact  time  on  EPA-registered  labels  to  compensate 
for  the  unknown  margin  of  safety  in  EPA-recommended  efficacy  tests. 

Central  to  the  laboratory  simulation  question  is  the  controversy  over 
carrier-based  versus  suspension-based  disinfectant  efficacy  test 
methods.2  Scientists  disagree  over  whether  carrier-based  methods  pro¬ 
vide  a  greater  representative  link  between  laboratory  tests  and  actual 
use  than  suspension  tests  and  whether  this  purported  advantage  is 
offset  by  an  unacceptable  increase  in  variable  test  results.  Further,  some 
scientists  question  whether  labs  can  bias  test  results  by  identifying  and 
selectively  using  carriers  with  a  higher  probability  of  yielding  negative 
results.  Controversy  also  exists  over  whether  microorganisms  are  more 
resistant  to  chemical  disinfectants  in  carrier-based  methods  than  in  sus¬ 
pension-based  methods  and  over  whether  one  type  of  material  used  for 
the  carriers  is  better  than  another.  An  industry/state  ad  hoc  group, 
working  under  the  auspices  of  the  aqac,  and  other  scientists  have 
recently  concluded  that  carrier-based  methods  can  be  refined  to  reduce 
variable  test  results  by  using  different  carrier  materials  (e.g.,  glass 
versus  stainless  steel)  and  more  stringent  laboratory  procedures.  How¬ 
ever,  other  scientists  argue  whether  certain  carrier  materials,  such  as 


^Carrier  methods  test  a  product’s  effectiveness  against  a  test  microorganism  dried  on  a  “carrier”  (a 
small  cylinder  called  a  “penicylinder”).  Suspension  methods  test  a  product’s  effectiveness  against  a 
test  microorgEinism  suspended  in  solution.  The  purpose  of  the  carrier  is  to  simulate  the  surface  on 
which  the  product  would  be  used. 
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glass,  truly  represent  environmental  surfaces  likely  to  be  treated  with 
disinfectants.  They  also  question  whether,  even  granting  that  these 
materials  do  approximate  real  surfaces,  their  use  reduces  variability  to 
an  acceptable  level. 

Most  of  the  EPA-recommended  methods  for  demonstrating  efficacy  for 
various  types  of  disinfectant  claims  on  hard  surfaces  are  carrier-based 
methods.  Although  epa  generally  prefers  carrier-based  methods  because 
they  presumably  have  a  closer  link  with  reality,  it  has  accepted  a  few 
suspension-based  methods  for  disinfectant  claims  on  hard  surfaces,  such 
as  for  tuberculocidal  claims,  when  it  has  believed  that  the  claims  would 
be  as  stringent  as  the  claims  made  on  the  basis  of  carrier  methods. 


Validity  of  Performance 
Standards  Unknown 


Much  of  the  scientific  and  regulatory  controversy  over  the  efficacy  test 
methods  focuses  on  era’s  performance  standards  (pass/fail  criteria)  for 
the  methods.  Some  industry  officials  and  researchers  assert  that  the 
existing  performance  standards  are  invalid  and  need  to  be  changed. 
Conversely,  era  believes  that  the  standards  are  valid  for  registration 
purposes,  even  though  these  standards  were  adopted  many  years  ago 
without  the  benefit  of  statistical  analyses  that  would  be  performed  for 
new  standards  today,  era  plans  to  continue  using  the  standards  to  reg¬ 
ister  disinfectant  efficacy  claims  unless  investigations,  confirming  alle¬ 
gations  that  they  are  invalid,  show  that  these  standards  need  to  be 
changed. 

According  to  some  industry  members,  era’s  existing  performance  stan¬ 
dards  are  too  stringent — in  the  case  of  the  aqac  Sporicidal  Test,  nearly 
impossible  to  achieve — and  such  stringency  explains  why  certain  regis¬ 
tered  disinfectant  claims  could  not  be  substantiated  in  collaborative 
studies  and  state  enforcement  labs.  Members  of  industry  argue,  for 
example,  that  era’s  standard  for  a  hospital  disinfectant  claim  is  arbi¬ 
trary.  This  standard  permits  only  1  failure  out  of  each  set  of  60  test 
tubes  when  tested  by  the  aqac  Use-Dilution  Method  against  three  dif¬ 
ferent  microorganisms.  Industry  members  claim  that  such  a  standard 
does  not  adequately  allow  for  the  probability  that  other  factors  in  the 
test  (e.g.,  variation  in  the  number  of  test  microorganisms  in  each  test 
tube,  variation  in  the  carriers)  could  explain  why  an  effective  disinfec¬ 
tant  might  sometimes  fail  the  test. 

Some  ERA  officials  believe  members  of  industry  have  tried  to  encourage 
era  to  relax  its  performance  standards  to  avoid  possible  enforcement 
action  on  ineffective  disinfectants.  Despite  the  alleged  variabilities  in 
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efficacy  test  results  and  stringency  in  performance  standards,  the  data 
that  EPA  receives  from  registrants  rarely  shoiv  such  variabilities  or  that 
disinfectants  fail  to  meet  existing  standards.  Researchers  and  state 
enforcement  labs  have  been  unable  to  substantiate  claims  for  some  reg¬ 
istered  disinfectants.  Further,  according  to  EPA/state  officials,  certain 
registered  disinfectants  have  failed  state  and  federal  enforcement  tests 
by  such  a  wide  margin  that  the  disinfectants  tested  would  be  judged 
ineffective  by  almost  any  performance  standard,  era  officials  and  others 
have  suggested  that  because  some  types  and  concentrations  of  active 
ingredients  yield  highly  variable  test  results,  disinfectants  with  these 
ingredients  may  need  to  be  reformulated  with  greater  concentrations  or 
with  different  ingredients,  or  claim  longer  contact  times.  Industry  offi¬ 
cials  counter  that  increasing  the  concentration  of  active  ingredients  in 
their  disinfectants  will  increase  product  costs  and  toxicity  and  may  not 
improve  the  “effectiveness”  of  the  disinfectants  in  actual  use.  (We  dis¬ 
cuss  the  possibility  that  some  registrants  may  have  selectively  sub¬ 
mitted  data  for  registration  in  ch.  3  and  the  need  for  post-registration 
enforcement  tests  in  ch.  4.) 

Disagreement  also  exists  over  whether  and  how  the  existing  perform¬ 
ance  standards  should  be  changed.  Some  researchers  argue  that  the 
alleged  variabilities  in  the  test  methods  need  to  be  resolved  before  the 
performance  standards  can  be  modified  since  changing  the  standards  to 
allow  for  test  variabilities  may  increase  the  probability  that  epa  would 
accept  an  ineffective  product.  However,  according  to  members  of 
industry,  the  standards  can  be  modified  on  the  basis  of  theoretical  calcu¬ 
lations  while  the  methods  are  being  improved. 


Methods  Acceptance 
Process  Inadequate 


era’s  process  for  accepting  disinfectant  efficacy  test  methods  has  con¬ 
tributed  to  the  controversies  surrounding  the  methods.  Over  the  years, 
era  has  accepted  some  disinfectant  efficacy  test  methods  and  modifica¬ 
tions  to  the  methods — usually  to  register  product  claims  at  industry’s 
urging — that  have  not  been  developed  and  accepted  by  independent 
standard-setting  organizations,  era  has  accepted  the  methods  and  modi¬ 
fications  on  the  basis  of  internal,  and  in  some  cases  external,  scientific 
peer  review  and  regulatory  judgment.  However,  era  lacks  criteria  for 
assessing  the  validity  of  proposed  new  test  methods  or  significantly 
modified  test  methods.  Furthermore,  although  era  does  not  indepen¬ 
dently  validate  methods  and  does  not  require  registrant-proposed 
methods  and  significant  modifications  to  undergo  collaborative  testing 
and  evaluation  prior  to  acceptance,  era  scientists  told  us  that  they 
cannot  evaluate  the  validity  of  new  methods  or  significant  modifications 
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without  a  laboratory  evaluation,  epa’s  experience  in  accepting  alterna¬ 
tive  methods  for  substantiating  tuberculocidal  and  other  claims  suggests 
that  EPA  needs  criteria  for  assessing  the  validity  of  registrant-proposed 
methods  and  significant  modifications,  including  criteria  for  determining 
when  laboratory  data,  such  as  from  a  collaborative  study,  are  needed  to 
demonstrate  validity. 


Lack  of  Criteria  to  Assess 
Validity 


Under  epa  regulations,  registrants  may  use  any  test  method  to  demon¬ 
strate  product  performance  as  long  as  the  test  method  used  meets  the 
purpose  of  the  test  standards  specified  in  epa’s  Pesticide  Assessment 
Guidelines  and  provides  data  of  suitable  quality  and  completeness  as 
typified  by  the  methods  that  era  recommends  in  the  guidelines,  era  also 
allows  registrants  to  modify  the  recommended  methods  to  make  them 
suitable  for  a  particular  product  claim,  such  as  effectiveness  against 
target  microorganisms  in  the  presence  of  organic  matter  and  hard  water. 
However,  under  the  guidelines,  registrants  are  responsible  for  demon¬ 
strating  the  validity  of  the  test  method  or  modification  selected  to  sub¬ 
stantiate  product  efficacy.  According  to  the  Director,  Office  of  Pesticide 
Programs,  consistent  testing  with  uniform  and  valid  methods  is  essential 
forjudging  the  comparability  of  efficacy  test  results. 


As  noted  in  chapter  1,  era  has  primarily  relied  on  the  aqac  and  other 
independent  standard-setting  organizations  as  sources  for  the  recom¬ 
mended  methods  published  in  the  guidelines.  However,  because  these 
organizations  have  not  published  methods  for  demonstrating  all  types  of 
disinfectant  efficacy  claims,  era  guidelines  do  not  contain  standard 
methods  for  demonstrating  all  types  of  claims.  For  example,  the  guide¬ 
lines  do  not  contain  a  standardized  method  for  registrants  to  use  to 
demonstrate  that  products  are  virucidal  when  used  on  hard  surfaces. 
Instead,  era’s  guidelines  contain  minimum  specifications  (parameters) 
with  which  registrants  must  comply  to  make  these  types  of  efficacy 
claims. 


era  has  primarily  relied  on  scientists  in  the  Antimicrobial  Program 
Branch  to  review  the  validity  of  proposed  new  methods  and  modifica¬ 
tions.  In  cases  where  registrants  have  proposed  an  alternative  method 
that  represents  a  major  departure  from  existing  ERA-approved  methods, 
ERA  has  consulted  the  scientific  community,  including  the  fifra  Scientific 
Advisory  Panel,®  the  Centers  for  Disease  Control  (cdc),  and  the  Food  and 


®The  FIFRA  Scientific  Advisory  Panel  is  a  statutorily  created  panel  of  experts  convened  to  review 
major  pesticide  decisions  or  regulations  and  to  give  advice  to  the  Administrator,  EPA. 
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Drug  Administration  (fda),  before  accepting  the  method.  However,  epa 
has  not  developed  written  criteria  that  methods  must  meet  for  epa  to 
consider  them  valid.  Further,  epa  has  recognized  that  laboratory  evalua¬ 
tions  are  sometimes  needed  to  assess  the  validity  of  new  methods  and 
significantly  modified  methods.  In  particular,  according  to  epa  scientists, 
it  is  difficult  for  them  to  determine,  in  the  absence  of  laboratory  evalua¬ 
tions,  the  extent  to  which  new  test  methods  and  significantly  modified 
methods  are  reproducible  and  reliable. 

epa  officials  argue  that  epa  needs  the  regulatory  flexibility  to  accept  new 
or  alternative  methods  to  respond  to  changes  in  infection  control  needs 
and  product  claims.  Further,  epa  officials  claim  that  collaborative 
testing  of  methods  prior  to  acceptance  is  a  lengthy  process  usually 
requiring  2  or  more  years  to  complete  and  that  epa  lacks  the  laboratory 
facilities  and  personnel  to  validate  registrant-submitted  test  methods 
independently.  However,  era  officials  acknowledge  that  collaborative 
testing  of  methods  is  scientifically  ideal  and  that  reviewing  registrant- 
proposed  methods  and  modifications  is  an  insufficient  mechanism  for 
evaluating  the  comparability  of  results  obtained  with  multiple  methods 
for  substantiating  one  type  of  efficacy  claim. 


Problems  With  Multiple 
Tuberculocidal  Methods 


Since  about  1976,  era  has  received  conflicting  reports  about  the  effec¬ 
tiveness  of  glutaraldehyde-based  products  when  tested  by  the  aqac 
Tuberculocidal  Activity  Method — a  carrier-based  test.  (Glutaraldehyde 
is  one  of  the  most  widely  used  active  ingredients  for  hospital  disinfec¬ 
tants.)  Researchers  from  a  leading  manufacturer  of  glutaraldehyde- 
based  products  submitted  evidence  to  era  indicating  that  none  of  six 
glutaraldehyde-based  products  tested,  including  the  manufacturer’s 
product,  met  their  label  claims  of  killing  tuberculosis  bacteria  in  10  or  20 
minutes  at  200  (about  68“F)  when  tested  under  the  aqac  method.  The 
researchers  claimed  that  glutaraldehyde  was  more  sensitive  to  tempera¬ 
ture  than  previously  thought  and  that  variables  in  the  method,  particu¬ 
larly  the  carrier,  led  to  inconsistent  and  erroneous  results,  era  has 
reported  that  it  obtained  similar  inconsistencies  in  its  preregistration 
testing  of  tuberculocidal  products  using  the  aqac  method  at  its  testing 
facility  in  Beltsville,  Maryland,  between  1971  and  1979.  In  1983,  the 
industry  researchers,  also  key  aqac  officials,  submitted  a  quantitative 
suspension  test,  intended  to  replace  the  aqac  Tuberculocidal  Activity 
Method,  to  era. 

In  May  1986,  on  the  basis  of  internal  review  and  its  analysis  of  two  sep¬ 
arate  FIFRA  Scientific  Advisory  Panel  subpanel  reviews,  era  concluded 
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that  both  the  aoac  method  and  the  proposed  quantitative  suspension 
method  had  merit,  epa  decided  to  allow  registrants  to  choose  from  one  of 
three  testing  options  to  substantiate  tuberculocidal  claims.  In  June  1986, 
EPA  required  registrants  of  all  tuberculocidal  products  to  submit  new 
data  to  support  the  claim  using  the  new  quantitative  method,  the  aoac 
Tuberculocidal  Activity  Method,  or  the  aoac  method  with  substantial 
modification  of  the  contact  time  and/or  temperature,  era  also  required 
registrants  of  certain  chemical  classes  to  submit  test  data  from  a  second, 
independent  laboratory  to  validate  test  results  from  the  first  laboratory. 
(In  1987,  the  aoac  edited  its  tuberculocidal  activity  method  to  state  that 
the  method  had  not  been  validated  for  glutaraldehyde-based  products.) 

As  of  February  1989, 44  out  of  144  products  had  satisfied  era’s  request 
for  data;  the  remaining  products  either  deleted  their  tuberculocide  label 
claims  or  were  suspended  or  canceled.  Of  the  44, 1 1  used  the  new 
method,  25  used  the  standard  aoac  method,  and  8  used  the  modified 
method.  The  19  products  that  relied  on  either  the  new  method  or  the 
modified  aoac  method  resulted  in  label  claims  of  either  use  at  higher 
temperature  or  different  contact  time  or  both. 

Although  most  registrants  submitted  data  using  only  one  of  the  test 
options,  several  registrants  developed  data  using  more  than  one  test 
option.  According  to  era,  the  data  indicated  that  one  glutaraldehyde- 
based  product  passed  both  the  standard  aoac  method  and  the  quantita¬ 
tive  method  but  at  significantly  different  contact  times.  Under  the  stan¬ 
dard  aoac  method,  the  product  was  tuberculocidal  (i.e.,  killed  100 
percent  of  the  test  bacteria)  in  10  minutes  at  20‘>C,  but  under  the  quanti¬ 
tative  method,  the  product  was  tuberculocidal  in  55  minutes  at  20‘U. 
Despite  the  disparity  in  test  results,  era  accepted  the  label  claim  for  the 
product  on  the  basis  of  the  standard  aoac  test  because  it  had  allowed 
registrants  the  option  of  choosing  which  test  to  use.  era  concluded  that 

There  is  no  technical  information  available  on  which  to  base  a  scientific  judgment  of 
the  reason(s)  for  the  significant  differences  in  required  contact  time  for 
tuberculocidal  effectiveness.  It  is  unknown  whether  the  difference  is:  an  unintended 
confirmation  of  the  questionable  efficacy  test  results  alleged  to  occur  when 
glutaraldehydes  are  tested  by  the  standard  AOAC  method;  attributable  to  some  defi¬ 
ciency  in  the  quantitative  method;  or  attributable  to  other  testing  or  product  related 
factors. 

EPA  has  acknowledged  that  controlled  laboratory  studies  are  needed  to 
comparatively  evaluate  the  three  test  options,  era  has  also  acknowl¬ 
edged  that  the  quantitative  test  needs  to  be  collaboratively  evaluated. 
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Despite  these  limitations,  era  continues  to  alloiv  registrants  to  choose 
from  among  the  three  options  to  support  tuberculocidal  claims. 

Although  7  years  have  passed  since  the  quantitative  method  was  first 
submitted  to  era,  the  agency  still  lacks  definitive,  independent  labora¬ 
tory  data  showing  that  the  aoac  Tuberculocidal  Activity  Method  is 
invalid  or  that  the  quantitative  suspension  method  is  valid.  In  addition, 
the  quantitative  suspension  test  has  yet  to  be  collaboratively  tested  and 
approved  by  the  aoac  because  of  statistical  design  problems  and  lack  of 
laboratory  participation  in  a  collaborative  study,  era  has  been  trying  to 
comparatively  evaluate  the  aoac  Tuberculocidal  Activity  Method  and 
the  quantitative  suspension  test  at  its  laboratory  facilities  in  Beltsville, 
Maryland,  but  the  lab  has  had  problems  with  equipment  and  with 
growing  the  test  organism.  As  part  of  a  1990  research  initiative,  dis¬ 
cussed  below,  ERA  plans  to  fund  research  to  assess  the  validity  of  the 
AOAC  Tuberculocidal  Activity  Method. 


The  tuberculocide  example  is  not  unique,  era  has  accepted  other  disin¬ 
fectant  efficacy  methods  and  significant  modifications  to  methods  that 
have  not  undergone  collaborative  studies  to  validate  test  procedures. 
For  example,  era  has  allowed  registrants  to  modify  test  methods  by 
adding  hard  water  and  organic  matter  to  simulate  actual  use  without 
knowing  how  these  additions  affect  the  validity  of  the  methods  used. 

era  has  also  accepted  similar  efficacy  claims  for  different  disinfectants 
on  the  basis  of  multiple  methods  without  laboratory  data  assessing 
whether  the  methods  yield  comparable  results.  For  example,  era  allows 
registrants  to  use  either  a  modified  form  of  the  aoac  Use-Dilution 
Method  or  the  aoac  Fungicidal  Test  to  make  fungicidal  claims.  However, 
in  one  case,  the  State  of  Florida  tested  and  failed  a  product  using  the 
aoac  Fungicidal  Test  but  could  not  take  any  enforcement  action  because 
ERA  had  registered  the  product  on  the  basis  of  passing  test  results  the 
registrant  had  submitted  using  the  aoac  Use-Dilution  Method. 


Other  Test  Method 
Problems 


Limited  Progress  Made 
in  Resolving 
Controversies 


Although  ERA  has  known  about  the  scientific  controversies  surrounding 
its  recommended  disinfectant  efficacy  test  methods  and  standards  for 
most  of  the  last  decade,  it  has  not  made  much  progress  in  resolving  the 
controversies.  Between  1983  and  1989,  era  funded  limited  research  to 
improve  disinfectant  efficacy  methods.  However,  the  research  did  not 
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fulfill  epa’s  objectives  because  epa  inadequately  managed  it.  Further¬ 
more,  although  EPA  developed  a  strategy  in  1987  to  improve  the  disinfec¬ 
tants  program  that  included,  as  its  most  important  element,  proposed 
research  on  test  methods,  epa  has  made  limited  progress  in  completing 
the  research  because  of  budgetary  constraints.  A  new  research  initiative 
is  a  step  in  the  right  direction,  but  more  work  remains  to  be  done. 


Research  Not  Managed  Between  October  1983  and  October  1989,  era  spent  about  $384,000  on 

two  consecutive  cooperative  agreements  with  the  University  of  North 
Carolina  at  Chapel  Hill  (UNC)  to  update  and  improve  the  aoac  Use-Dilu¬ 
tion  Method,  Tuberculocidal  Activity  Method,  and  Sporicidal  Test.^  UNC 
researchers  investigated  19  presumed  deficiencies  in  the  aoac  Use-Dilu¬ 
tion  Method  and  conducted  two  collaborative  studies  to  evaluate  vari¬ 
abilities  in  that  method  and  in  a  slightly  modified  version  of  it.  In 
addition,  they  conducted  preliminary  investigations  on  an  alternative 
quantitative  suspension  method,  conducted  preliminary  investigations 
on  the  AOAC  Tuberculocidal  Activity  Method,  and  conducted  preliminary 
evaluations  of  tuberculocidal  claims  of  certain  products,  as  well  as  other 
investigations.  On  the  basis  of  the  research  conducted,  unc  researchers 
concluded  that  the  aoac  Use-Dilution  Method  and  the  slightly  modified 
version  were  subject  to  extreme  inter-laboratory  variability,  mostly  due 
to  the  carrier,  and  should  not  be  used  for  registration  or  enforcement 
purposes.  The  researchers  recommended  that  an  alternative  method, 
such  as  a  quantitative  suspension  test,  replace  the  aoac  Use-Dilution 
Method. 

EPA  believes  that  the  unc  researchers  did  not  fulfill  the  primary  intent  of 
the  cooperative  agreements  because  they  focused  on  examining  deficien¬ 
cies  in  the  aoac  Use-Dilution  Method  rather  than  correcting  the  deficien¬ 
cies  to  reduce  variability  and  establish  new  pass/fail  criteria,  epa 
officials  strongly  criticized  UNC’s  research  conclusions  because  of  a  dis¬ 
pute  on  the  relative  merits  of  carrier-  versus  suspension-based  disinfec¬ 
tant  efficacy  test  methods.  These  officials  do  not  believe  that  the  unc 
research  results  definitively  show  that  the  aoac  Use-Dilution  Method  is 
valid  or  invalid  because  of  methodological  limitations  in  the  research. 
They  also  believe  that  the  research  results  might  reflect  deficiencies  in 
registered  products  rather  than  irreparable  problems  with  the  method. 


^The  total  value  of  the  cooperative  agreements  was  $404,340,  with  EPA  contributing  $383,709  and 
UNC  contributing  $20,631.  On  February  28, 1990,  EPA  extended  the  project  period  of  the  second 
agreement  to  May  23, 1990,  at  no  cost  to  the  federal  government  to  allow  UNC  researchers  time  to 
complete  their  final  report. 
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In  fact,  EPA  officials  believe  that  the  UNC  research  showed  that  the  pri¬ 
mary  source  of  the  alleged  variability  in  the  aoac  Use-Dilution  Method — 
the  stainless  steel  carrier — can  be  mitigated  by  using  glass  carriers  and 
has  endorsed  the  efforts  of  the  ad  hoc  industry/state  group  to  this  end. 
Disappointed  with  the  UNC  research,  epa  reduced  the  amount  of  funding 
under  the  cooperative  agreement  during  the  last  2  years  and  delayed 
funding  while  deciding  whether  to  continue  the  agreement. 

In  their  own  defense,  the  UNC  researchers  pointed  out  that  epa  officials, 
especially  those  in  the  Antimicrobial  Program  Branch,  were  not  highly 
critical  of  the  research  until  1987,  when  the  aoac  began  to  consider 
repealing  the  aoac  Use-Dilution  Method  on  the  basis  of  the  UNC  research 
results.  According  to  the  UNC  researchers,  era’s  criticisms  of  the 
research  may  be  the  reaction  of  someone  shooting  the  messenger  of  bad 
news.  The  researchers  claimed  that  epa  officials  may  be  unwilling  to 
accept  the  prospect  that  the  most  widely  used  disinfectant  method,  upon 
which  thousands  of  product  claims  to  protect  the  public  health  are 
based,  may  be  invalid.  The  researchers  further  asserted  that  the  cost 
and  administrative  burden  of  reregistering  thousands  of  product  claims 
on  the  basis  of  a  new  method  may  be  prohibitive  in  the  eyes  of  era  offi¬ 
cials  who  manage  a  program  already  considered  to  be  of  lower  priority 
than  that  of  other  pesticide  programs. 

era’s  inadequate  management  of  the  UNC  cooperative  agreements  may 
have  contributed  to  the  controversy  over  the  research.  Under  era  regu¬ 
lations,  a  cooperative  agreement  is  a  form  of  financial  assistance  in 
which  epa  expects  to  be  substantially  involved  in  the  project  funded. 
era’s  project  officer  for  the  UNC  cooperative  agreements  (the  era  pro¬ 
gram  official  designated  to  manage  and  monitor  the  project),  also  a  key 
aoac  official  in  disinfectant  method  development,  did  not  appear  to  be 
substantially  involved  in  managing  and  monitoring  the  direction  and  pri¬ 
ority  of  research  at  unc  to  fulfill  era’s  research  objective.  Under  the 
terms  of  the  cooperative  agreements,  the  project  officer,  in  consultation 
with  the  UNC  researchers,  was  responsible  for  determining  the  nature 
and  scope  of  tasks  performed  under  the  agreements. 

The  records  of  the  project,  grant,  and  quality  assurance  officers  show 
that  the  era  project  officer  allowed  the  unc  researchers  to  develop  the 
work  plans  for  the  cooperative  agreements.  However,  the  project  officer 
and  other  era  officials  later  criticized  UNC’s  research  direction  and  the 
scope  of  work  and  tasks  unc  performed.  For  example,  the  project  officer 
criticized  the  methodology  of  UNC’s  second  collaborative  study  on  a  mod¬ 
ified  version  of  the  aoac  Use-Dilution  Method  after  unc  completed  the 
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work.  In  addition,  according  to  the  project  officer,  he  did  not  insist  on 
the  quarterly  progress  reports  the  second  cooperative  agreement  called 
for  from  UNC  because  he  did  not  think  that  sufficient  funds  were  avail¬ 
able  under  the  cooperative  agreement  for  UNC  to  complete  these  reports. 

The  dispute  between  era  and  UNC  over  the  research  may  have  been  com¬ 
pounded  by  a  lack  of  communication  and  coordination  within  era  and  a 
lack  of  top  management  involvement  in  the  early  years  of  the  coopera¬ 
tive  agreements.  The  era  project  officer  for  the  cooperative  agreements 
worked  in  the  Biological  and  Economic  Analysis  Division.  This  division 
is  separate  from  the  Registration  Division,  which  contains  the  Antimi¬ 
crobial  Program  Branch.  Although  the  UNC  research  was  intended  to 
support  the  Antimicrobial  Program  Branch,  which  registers  disinfec¬ 
tants,  it  appears  that  the  two  divisions  did  not  communicate  on  the 
scope  of  work  and  results  of  the  research,  since  the  Antimicrobial  Pro¬ 
gram  Branch  did  not  comment  on  the  cooperative  agreement  research 
until  1987. 

era  and  unc  have  also  disputed  other  issues  under  the  cooperative 
agreements,  era  has  criticized  unc’s  researchers  for  investigating  the 
claimed  tuberculocidal  efficacy  of  individual  products  rather  than  inves¬ 
tigating  the  validity  of  the  aoac  Tuberculocidal  Activity  Method,  era  has 
also  criticized  the  unc  researchers  for  publicizing  the  results  of  their 
research  on  tuberculocidal  disinfectants  before  sharing  them  with  era  as 
required  in  the  second  cooperative  agreement.  In  both  situations,  how¬ 
ever,  it  appears  that  era  officials  did  not  closely  manage  and  monitor 
the  cooperative  agreement  and  expressed  dissatisfaction  with  the 
researchers  and  research  results  only  after  the  work  was  completed  and 
publicized. 

We  do  not  know  whether  era’s  criticisms  of  unc’s  research  are  valid, 
reflect  reasonable  differences  in  scientific  judgment,  or  reflect  a  defen¬ 
sive  position  and  lack  of  acceptance  of  the  research  results.  However,  if 
ERA  is  ever  to  resolve  the  scientific  controversies  that  surround  disinfec¬ 
tant  efficacy  test  methods  and  performance  standards,  it  must  do  a 
better  job  of  managing  the  research. 


Limited  Progress  in 
Conducting  Planned 
Research 


In  response  to  mounting  criticisms  from  industry,  the  public-health  com¬ 
munity,  disinfectant  users,  the  Congress,  and  others,  era  developed  a 
strategy  to  improve  its  regulation  of  disinfectants  in  1987,  which  pro¬ 
posed  research  on  the  methods  and  standards  era  recommends.  How¬ 
ever,  ERA  has  made  limited  progress  in  conducting  this  research  because 
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of  budget  constraints.  A  recent  epa  research  initiative  is  a  step  in  the 
right  direction,  but  it  will  be  several  years  before  era  fully  addresses  the 
controversies  surrounding  disinfectant  efficacy  methods  and  standards. 
In  addition,  the  regulation  of  disinfectant  efficacy  may  be  hampered  by 
the  lack  of  an  adequate,  federal  laboratory  facility  to  conduct  disinfec¬ 
tant  efficacy  method  research  and  development. 

In  1986,  epa  convened  a  multi-office  work  group  to  analyze  alleged 
problems  with  disinfectant  efficacy  test  methods  and  also  hired  a  micro¬ 
biologist  consultant  to  provide  expertise  on  the  issues.  The  work  group 
identified  deficiencies  in  several  critical  areas  of  the  disinfectants  pro¬ 
gram,  including  those  areas  embroiled  in  the  scientific  controversies  dis¬ 
cussed  above,  and  explored  several  approaches  for  resolving  the 
deficiencies  that  would  not  depend  on  a  large-scale,  federally  operated 
testing  program.  The  work  group  concluded  that 


The  most  critical  and  most  recognized  deficiency  is  the  current  lack  of  credibility  of 
the  standard  efficacy  test  methods  utilized  in  the  registration  program,  particularly 
the  AOAC  test  procedures.  Any  attempt  to  improve  the  [disinfectant]  efficacy  pro¬ 
gram  is  contingent  upon  re-establishing  the  credibility  of  the  existing  methods; 
updating/revising  the  existing  methods;  or  developing  new  methods. 

To  resolve  the  deficiencies,  the  work  group  developed  a  five-point 
strategy  that  included  improving  or  replacing  existing  efficacy  methods. 
The  work  group  estimated  that  epa  would  need  about  $1.5  million  in 
contract  funds  to  evaluate  the  methods. 

Between  1987  and  1990,  epa  made  limited  progress  in  conducting  its 
planned  research  because  of  competing  program  priorities  and  budget 
constraints,  according  to  the  Chief,  Antimicrobial  Program  Branch. 
According  to  a  June  1990  strategy  update,  “Because  of  budget  con¬ 
straints,  era’s  past  efforts  in  conducting  evaluations  of  current  test 
methods  have  been  limited.” 

Recognizing  its  resource  limitations,  era  challenged  industry,  user 
groups,  and  others  to  coordinate  resources  to  achieve  mutual  research 
goals.  In  response  to  this  challenge,  the  aforementioned  ad  hoc  industry/ 
state  group,  funded  by  individual  participating  laboratories,  conducted 
a  collaborative  study  of  a  new  hard-surface  carrier  test  in  1989.  era  offi¬ 
cials  believe  that  the  study  results  show  that  the  test,  which  they  con¬ 
sider  to  be  a  modified  version  of  the  aoac  Use-Dilution  Method,  is 
reproducible  and  reliable,  era  officials  expect  that  the  ad  hoc  group  will 
present  its  final  study  report  to  the  aoac  in  September  1990  and  that  the 
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AQAC  will  consider  replacing  the  existing  aoac  Use-Dilution  Method  with 
the  new  method,  era  will  consider  what  regulatory  actions,  if  any,  to 
take  on  the  basis  of  the  new  test  after  it  is  considered  by  the  aoac  and 
after  additional  research  is  completed  on  the  effects  of  using  hard  water 
and  organic  matter  in  the  method  and  on  the  appropriate  performance 
standard  for  the  method,  according  to  the  Chief,  Antimicrobial  Program 
Branch. 

In  April  1990,  era  announced  that  it  plans  to  support  three  cooperative 
agreements  over  a  2-year  project  period  to  conduct  research  and  devel¬ 
opment  on  validating,  revising,  or  replacing  the  aoac  Tuberculocidal 
Activity,  aoac  Sporicidal,  and  era  virucidal  test  methods  and  perform¬ 
ance  standards,  era  plans  to  spend  approximately  $600,000  in  fiscal 
year  1990  funds  on  this  research,  era  plans  to  award  the  cooperative 
agreements  by  September  30, 1990. 

Although  era’s  funding  initiative  represents  a  substantial  increase  in 
commitment  to  resolve  the  scientific  controversies,  the  Chief  of  the  Anti¬ 
microbial  Program  Branch  believes  that  the  initial  funding  will  be  insuf¬ 
ficient  to  resolve  the  controversies  completely.  She  estimates  that  era 
may  need  to  spend  an  additional  $1.2  million  to  completely  research  the 
alleged  problems  with  the  methods  and  standards. 

If  the  new  research  initiative  is  not  well  managed,  era,  industry,  disin¬ 
fectant  users,  consumers,  and  the  public  health  will  be  no  better  off  than 
they  are  today,  era  has  designated  the  Antimicrobial  Program  Branch, 
within  the  Registration  Division,  as  the  project  office  for  the  new  coop¬ 
erative  agreements  instead  of  the  Biological  and  Economic  Effects  Divi¬ 
sion,  which  was  the  project  office  for  the  UNC  cooperative  agreements. 
Further,  era  has  announced  that  it  “intends  to  be  involved  in  the  test 
methodology  research  and  development  by  approving  work  by  stages, 
approving  any  subcontracts,  conducting  on-site  visits/inspections  at  rea¬ 
sonable  intervals,  co-authoring  published  reports  relative  to  the  funded 
study,  and  halting  research  activity  if  the  intent,  approach,  or  antici¬ 
pated  phases  leading  to  the  accomplishment  of  the  study  are  not  being 
achieved,  or  have  been  revised  without  prior  Agency  approval.” 

Although  this  approach  may  resolve  some  of  the  management  problems 
ERA  experienced  with  the  UNC  cooperative  agreements,  era  might  want  to 
request  that  the  nPRA  Scientific  Advisory  Panel  provide  advice  on  the 
research  direction  and  results,  era’s  1987  strategy  paper  called  for  the 
panel’s  assistance  to  help  evaluate  research  priorities,  among  other 
things,  but  as  of  June  1990,  era  had  not  convened  the  panel  for  this 
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purpose.  In  addition  to  guidance  on  research  needs  and  priorities,  the 
FIFRA  Scientific  Advisory  Panel  could  provide  independent  confirmation 
of  the  need  for  any  regulatory  changes  that  might  be  indicated  by  the 
research,  such  as  the  need  to  reregister  disinfectants  on  the  basis  of  new 
methods  and  standards.  An  epa  decision  to  involve  the  fifra  Scientific 
Advisory  Panel  in  this  manner  would  be  consistent  with  the  internal 
control  principle  of  separating  key  functions  in  a  transaction  to  ensure 
that  effective  checks  and  balances  exist. 

Many  of  the  disinfectant  efficacy  test  methods  in  dispute  were  devel¬ 
oped  by  scientists  working  at  the  federal  government’s  laboratory  facili¬ 
ties  in  Beltsville,  Maryland,  era  discontinued  testing  disinfectants  at 
Beltsville  in  1982  primarily  because  of  budget  constraints.  Although  epa 
kept  the  laboratory  open  to  assist  in  a  limited  capacity  on  method  evalu¬ 
ation,  epa  officials  readily  admit  that  epa  lacks  the  personnel  and  facili¬ 
ties  to  do  the  necessary  methodology  research.  According  to  the  current 
laboratory  supervisor,  era’s  Beltsville  laboratory  facilities  would  not 
pass  epa’s  own  good  laboratory  practice  (GLP)  regulations.  (Ch.  5  dis¬ 
cusses  options  for  a  disinfectant  laboratory.) 


Conclusions 


Disinfectants  are  used  to  reduce  the  risk  of  transmitting  infectious  dis¬ 
eases.  If  disinfectants  fail  to  work  as  claimed,  then  those  using  disinfec¬ 
tants  in  restaurants,  child  day  care  centers,  hospitals,  homes,  and  other 
places  may  be  placing  themselves  and  others  at  risk  and  wasting  their 
money. 

Doctors,  janitors,  consumers,  and  others  rely  on  era’s  registration  of  dis¬ 
infectants  as  assurance  that  these  products  work.  However,  scientific 
controversy  exists  over  the  validity  of  the  methods  and  standards  that 
EPA  reconunends  that  registrants  follow  in  order  to  substantiate  claims. 
Although  ERA  and  state  officials  have  accepted  allegations  that  there 
may  be  problems  with  the  methods  and  standards,  they  believe  that  the 
existing  methods  and  standards  are  acceptable  for  registration  and 
enforcement  purposes.  Nonetheless,  the  scientific  controversies  over  the 
adequacy  of  these  methods  and  standards  have  impaired  the  credibility 
of  era’s  registration  of  disinfectant  efficacy  claims. 

Although  disinfectant  efficacy  test  methods  and  performance  standards 
have  been  embroiled  in  scientific  controversies  for  over  a  decade,  era 
has  made  limited  progress  in  resolving  them  because  of  inadequate 
research  management  and  budget  constraints,  era  did  not  manage  and 
monitor  its  cooperative  agreements  with  UNC  well  because  it  lacked 
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internal  communication  and  agreement  on  research  tasks  and  results. 

EPA  also  has  made  limited  progress  in  conducting  additional  research 
because  of  budget  constraints.  In  April  1990,  epa  announced  that  it 
planned  to  spend  approximately  $600,000  for  research  on  the  scientific 
controversies  surrounding  certain  disinfectant  efficacy  methods  over  a 
2-year  period.  Although  this  initiative  is  significant,  more  research, 
requiring  time  and  additional  resources,  will  be  needed. 

Although  we  do  not  expect  epa  to  ever  eliminate  all  scientific  disputes 
over  these  methods  and  standards,  the  agency  could  better  protect  the 
public  health  by  raising  the  degree  of  certainty  about  the  validity  of  dis¬ 
infectant  efficacy  methods  and  standards.  A  detailed  plan  that  would 
describe  a  research  strategy  to  resolve  the  controversies  surrounding 
the  existing  disinfectant  efficacy  test  methods  and  performance  stan¬ 
dards  would  help  guide  this  effort  by  establishing  milestones  and  cost 
estimates.  In  addition,  the  fifra  Scientific  Advisory  Panel  could  assist  in 
developing  the  plan  and  overseeing  epa’s  research  direction  and 
management. 

epa’s  process  for  accepting  and  recommending  disinfectant  efficacy  test 
methods  and  standards  has  contributed  to  the  scientific  controversies 
surrounding  methods  and  standards,  era  has  accepted  methods  and 
modifications  to  methods  without  independent  laboratory  data  that 
demonstrate  the  validity  of  the  procedures  or  standards.  Furthermore, 
EPA  lacks  criteria  for  assessing  the  validity  of  new  methods  and  any  sig¬ 
nificant  modifications  to  methods,  epa  could  better  ensure  that  future 
registrant-proposed  disinfectant  efficacy  methods  and  modifications  are 
valid  by  establishing  specific  criteria  for  ascertaining  validity,  including 
criteria  for  determining  when  independent  laboratory  data,  such  as  col¬ 
laborative  study  data,  are  needed  to  assess  the  validity  of  proposed 
methods  or  modifications. 


Recommendations 


To  increase  the  degree  of  certainty  that  disinfectant  efficacy  test 
methods  and  standards  are  valid,  we  recommend  that  the  Adminis¬ 
trator,  EPA,  develop  a  detailed  plan,  including  cost  estimates  and  mile¬ 
stones,  to  resolve  the  controversies  surrounding  existing  methods  and 
standards.  The  plan  should  include  a  research  strategy  that  addresses 
problems  with  the  alleged  variability  in  test  methods,  adequacy  of  lab 
tests  to  simulate  actual  use,  and  the  validity  of  performance  standards, 
as  discussed  in  this  chapter.  Further,  we  recommend  that  the  Adminis¬ 
trator,  EPA,  convene  the  fifra  Scientific  Advisory  Panel  to  assist  in 
developing  the  plan  and  overseeing  the  research  strategy  direction  and 
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management.  (See  ch.  5  for  options  on  establishing  a  laboratory  facility 
to  assist  in  researching  and  developing  disinfectant  efficacy  test 
methods.) 

In  addition,  we  recommend  that  the  Administrator,  epa,  develop  and 
publish  a  policy  that  establishes  specific  criteria  for  evaluating  the 
validity  of  new  disinfectant  efficacy  test  methods  and  modifications  to 
methods,  including  criteria  for  determining  when  independent  labora¬ 
tory  data,  such  as  data  from  a  collaborative  study,  are  needed  to  demon¬ 
strate  the  validity  of  proposed  methods  and  modifications. 
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Even  with  improvements  in  its  programs  to  ensure  the  validity  of  the 
test  methods  used  to  support  the  efficacy  of  disinfectants,  epa  would 
continue  to  lack  assurance  that  disinfectants  work  as  claimed,  epa  relies 
on  registrant-submitted  efficacy  data  to  make  decisions  about  whether 
to  register  individual  disinfectants  for  specific  claims  and  uses,  and  on 
its  data  review,  lab  inspection,  and  data  audit  programs  to  ensure  the 
quality  and  integrity  of  the  data.  However,  we  found  weaknesses  in 
these  programs  that  era  needs  to  address.  We  also  found  that  a  preregis¬ 
tration-testing  program  is  needed  to  supplement  these  programs  because 
they  generally  do  not  enable  epa  to  identify  cases  in  which  registrants 
have  selectively  submitted  incomplete  disinfectant  efficacy  data  or  have 
deliberately  submitted  invalid  data.  We  believe  era’s  lack  of  sufficient 
control  over  the  quality  and  integrity  of  registrant-submitted  disinfec¬ 
tant  efficacy  data  is  a  material  weakness  in  era’s  internal  controls  that 
should  be,  but  has  not  been,  reported  to  the  President,  as  required  by 
the  Federal  Managers’  Financial  Integrity  Act  of  1982  (fmfia). 


Weaknesses  Impair 
Data  and  Lab  Reviews 


ERA  reviews  registrant-submitted  disinfectant  efficacy  data  to  determine 
whether  proposed  label  claims  are  supported  by  the  data  and  whether 
registrants  have  made  any  major  mistakes  in  performing  efficacy  tests, 
interpreting  test  results,  or  translating  the  results  into  label  claims, 
according  to  the  Head,  Efficacy  Evaluation  and  Technical  Management 
Section,  Antimicrobial  Program  Branch.  In  addition,  era  inspects  the 
labs  that  generate  the  data  and  audits  laboratory  study  records  to  assess 
the  quality  and  integrity  of  the  data  and  the  competence  of  the  laborato¬ 
ries  that  have  performed  the  studies.  However,  we  found  that:  (1)  era 
has  inspected/audited  only  about  10  percent  of  all  of  the  labs  that  per¬ 
formed  disinfectant  efficacy  studies  submitted  to  era  over  about  a  4- 
year  period  and  has  identified  only  about  13  percent  of  all  the  labs  that 
performed  these  studies;  (2)  era  inspectors  and  auditors  may  be  unable 
to  evaluate  adequately  the  capability  of  labs  to  perform  these  studies; 
(3)  ERA  has  been  slow  to  prepare  and  process  reports  from  inspections 
and  audits  at  labs  performing  these  studies;  and  (4)  era  lacks  program 
guidance  for  conducting  data  reviews,  lab  inspections,  and  data  audits 
relating  to  these  studies. 


Not  All  Labs  Inspected 


The  Laboratory  Data  Integrity  Assurance  Division  (ldiad),  within  the 
Office  of  Compliance  Monitoring  (ocm),  is  responsible  for,  among  other 
things,  inspecting  laboratories  that  perform  studies  submitted  to  era  to 
support  pesticide  registrations  and  for  auditing  these  studies.  The  objec¬ 
tives  of  good  laboratory  practice  (glr)  inspections  are  to  ensure  that  a 
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lab  follows  specific  test  methods,  adheres  to  standard  operating  proce¬ 
dures,  keeps  records  in  compliance  with  glp  regulations,  and  conforms 
to  required  safety  and  quality  assurance  procedures  so  that  lab  prac¬ 
tices  do  not  compromise  the  quality  and  integrity  of  data  submitted  to 
EPA  for  registration  purposes.  ‘  The  objectives  of  data  audits  are  to 
ensure  that  the  data  underlying  a  study  are  both  present  at  the  lab  and 
fully  substantiate  the  study  results  by  comparing  the  data  from  the 
study  submitted  to  epa  with  records  on  the  study  in  the  lab.  A  data 
auditor  typically  audits  a  study  at  the  same  time  that  an  inspector 
inspects  the  lab  that  performed  the  study,  ldiad’s  goals  are  to  inspect  all 
labs  performing  efficacy  studies  approximately  every  2  years,  audit  one 
or  more  efficacy  studies  from  each  lab  inspected,  and  inspect  high- 
volume  labs  first. 

Between  January  1, 1985,  and  September  30, 1989,  ldiad  conducted  13 
lab  inspections  and  14  data  audits  at  9  individual  labs  that  performed 
disinfectant  efficacy  tests.  These  9  labs  represent  only  about  10  percent 
of  the  92  labs  that  had  generated  disinfectant  efficacy  data  received  by 
ERA  between  January  1, 1986,  and  June  26, 1989.  The  9  labs  that  ldiad 
inspected  generated  an  estimated  40  percent  of  the  1,148  disinfectant 
efficacy  studies  that  epa  received  during  that  period,  ldiad  audited  109 
studies  at  the  9  labs. 

LDIAD  did  not  inspect  most  of  the  labs  that  had  performed  disinfectant 
efficacy  studies.  In  fact,  ldiad  identified  only  12  (about  13  percent)  of 
the  92  labs  that  had  performed  these  studies,  ldiad  was  unaware  of 
most  of  the  labs,  including  some  high-volume  labs,  because  it  had  not 
used  epa’s  Pesticide  Document  Management  System  (pdms)  to  identify 
labs  for  inspections/audits.  This  system  is  a  central  archive  primarily 
consisting  of  documents  that  registrants  have  submitted  to  era  to  sup¬ 
port  pesticide  registrations,  and  we  used  it  to  identify  labs  that  had  per¬ 
formed  disinfectant  efficacy  studies  submitted  to  era. 


Lab  Capability  Not 
Adequately  Assessed 


Existing  era  program  guidance  specifies  that  lab  inspections  are  per¬ 
formed  while  a  study  is  in  progress,  that  they  provide  the  inspector  with 
an  opportunity  to  observe  laboratory  techniques,  and  that  they  ensure 
that  labs  follow  specific  test  methods  correctly.  Various  officials  from 


hn  August  1989,  EPA  published  GLP  regulations  governing  efficacy  studies.  These  regulations 
became  effective  on  October  16, 1989.  Before  this  date,  EPA  could  not  enforce  good  laboratory  prac¬ 
tices  of  laboratories  that  performed  disinfectant  efficacy  tests. 
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EPA,  the  states  that  operate  disinfectant  efficacy  testing  programs,  com¬ 
mercial  labs,  and  industry,  as  well  as  the  aoac,  have  stated  that  the 
results  of  a  disinfectant  efficacy  test  are  very  sensitive  to  small  varia¬ 
tions  in  the  way  the  technician  performs  the  test  procedures  and  that 
lab  personnel  must  have  extensive  experience  to  perform  disinfectant 
efficacy  tests  correctly.  However,  according  to  a  June  1987  epa  strategy 
document,  many  of  the  labs  testing  disinfectants  for  efficacy  do  not 
follow  prescribed,  standard  efficacy  test  methods. 

Although  the  tests  are  operator-sensitive,  lab  inspectors  and  data  audi¬ 
tors  generally  do  not  observe  disinfectant  efficacy  tests  in  progress 
because  epa  has  no  means  of  identifying  most  of  the  studies  ultimately 
submitted  to  epa  while  they  are  still  in  progress,  according  to  the  Chief, 
Scientific  Support  Branch,  ldiad.  In  addition,  the  branch  chief  told  us 
that  disinfectant  efficacy  tests  generally  are  so  short  in  duration  that  it 
is  difficult  for  ldiad  to  schedule  an  inspection  at  a  lab  performing  such  a 
test  before  the  test  is  complete.  One  epa  efficacy  data  auditor  told  us 
that  inspectors  and  auditors  do  not  usually  see  labs  performing  efficacy 
tests  because  most  labs  do  not  run  efficacy  tests  on  a  continuous  basis. 

The  five  era  data  auditors  who  have  audited  disinfectant  efficacy 
studies,  as  well  as  state  lab  officials  and  researchers,  told  us  that  a 
check  sample  program  could  ensure  the  quality  of  the  data  registrants 
submit  better  than  data  audits  can.  epa  currently  requires  states  that 
have  cooperative  pesticide  enforcement  agreements  with  epa  to  partici¬ 
pate  in  a  check  sample  program.  Under  the  program,  era  sends  the  state 
labs  samples  of  pesticide  formulations  and  residues  for  analysis  to 
ensure  that  they  perform  analytical  tests  correctly,  epa  could  adopt  a 
similar  program  for  laboratories  that  conduct  disinfectant  efficacy 
studies  to  ensure  that  they  are  capable  of  performing  efficacy  tests  cor¬ 
rectly.  Under  the  program,  era  would  send  samples  of  formulations  of 
known  efficacy  to  a  lab,  ask  the  lab  to  test  the  samples  for  efficacy,  then 
check  the  lab’s  results  against  the  known  efficacy  of  the  samples. 
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ldiad’s  target  time  frame  for  conducting  inspections  and  audits  and 
processing  reports  is  112  days  (about  3.5  months).  However,  ldiad  had, 
as  of  November  13, 1989,  taken  539  days  (about  1.5  years)  on  average 
to  perform  and  process  reports  from  inspections/audits  at  labs  per¬ 
forming  disinfectant  efficacy  studies.^  The  times  ranged  from  161  to  963 
days  (about  5  months  to  over  2.5  years).  The  5  inspection/audit  reports 
that  remained  open  as  of  November  13, 1989,  had  been  open  an  average 
of  360  days.  The  longest  report  had  been  open  over  1.5  years  since  the 
lab  was  first  inspected. 

LDIAD  has  been  slow  in  processing  these  lab  inspection  and  data  audit 
reports  for  three  reasons,  according  to  the  Chief,  Scientific  Support 
Branch.  First,  most  lab  inspectors  and  data  auditors  are  not  directly 
accountable  to  ldiad.  Instead,  most  lab  inspectors  are  stationed  in  era’s 
regional  offices  and  have  other  noninspection-related  duties  that  the 
regional  offices  consider  of  higher  priority  than  the  duty  of  preparing 
lab  inspection  reports.  Second,  according  to  this  official,  until  recently, 
the  ERA  headquarters  staff  available  to  perform  inspections  and  process 
inspection/audit  reports  at  era  headquarters  was  too  small.  Third,  era 
did  not  have  enforceable  glr  regulations  for  efficacy  studies  until 
October  16, 1989,  so  ldiad  considered  processing  inspection/audit 
reports  relating  to  labs  performing  these  studies  to  be  a  low  priority. 

The  Director,  ldiad,  acknowledged  that  era  has  been  slow  in  processing 
inspection/audit  reports  related  to  disinfectant  efficacy  studies  as  well 
as  other  types  of  registration  studies.  To  address  the  problem,  ldiad  is 
developing  a  simplified  reporting  format  and  a  procedure  for  processing 
those  reports  that  indicate  a  violation  first. 


Processing  Inspection/ 
Audit  Reports  Takes 
Nearly  Five  Times  Longer 
Than  Estimated 


Program  Guidance  Lacking  Scientists  in  the  Antimicrobial  Program  Branch  review  registrant-sub¬ 
mitted  reports  summarizing  the  results  of  efficacy  tests  before  regis¬ 
tering  disinfectant  efficacy  claims.  As  of  June  1990,  era  had  not 
completed  final  guidelines  for  these  scientists  to  use  in  conducting  effi¬ 
cacy  data  reviews,  although  it  had  prepared  guidelines  for  performing 
reviews  of  most  other  types  of  pesticide  registration  data  (e.g.,  chemical, 
toxicological,  environmental,  and  ecological  data).  With  such  guidelines, 
ERA  could  better  ensure  that  its  reviewers  identify  all  potential  problems 
with  efficacy  data,  era  could  not  estimate  when  final  guidelines  would 
be  published. 


^This  finding  is  based  on  the  9  of  10  inspection/audit  reports  ERA  had  prepared  and  completely 
processed  as  of  November  13, 1989,  and  for  which  ERA  could  provide  information. 
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Similarly,  as  of  June  1990,  epa  had  not  developed  guidance  for  con¬ 
ducting  inspections  and  data  audits  at  labs  that  have  performed  disin¬ 
fectant  efficacy  studies.  Instead,  according  to  the  Chief,  Scientific 
Support  Branch,  ldiad,  inspectors  have  been  using  era’s  manual  gov¬ 
erning  inspections  at  labs  that  have  performed  health-effects  studies. 
According  to  this  official,  era’s  efficacy  data  auditors  have  relied  on 
their  professional  judgment  to  perform  the  audits.  (Although  two  of  the 
auditors  have  developed  questionnaires  for  use  in  conducting  efficacy 
data  audits,  not  all  five  use  them.) 

In  addition,  as  of  June  1990,  era  had  not  published  guidelines  specifying 
the  types  of  inspection/audit  findings  that  would  prompt  registration 
and/or  enforcement  action  by  era  and  the  type  of  action  era  should  take 
in  each  case.  Although  the  Registration  Division  has  developed  a  stan¬ 
dard  operating  procedure  for  managing  the  review  and  disposition  of 
inspection/audit  reports,  the  procedure  does  not  specify  criteria  for 
evaluating  what  registration  action,  if  any,  the  division  should  take  on 
the  basis  of  report  findings.  An  ldiad  work  group  has  developed  interim 
guidelines  on  taking  enforcement  action  that  are  undergoing  internal 
review. 


Preregistration 
Testing  Needed  to 
Ensure  Data  Integrity 


Even  if  the  weaknesses  we  found  in  era’s  data  review,  lab  inspection, 
and  data  audit  programs  were  corrected,  the  programs  generally  would 
not  enable  era  to  identify  cases  in  which  registrants  have  selectively 
submitted  incomplete  disinfectant  efficacy  data,  era’s  position  is  that 
registrants  are  required  by  fifra  to  submit  all  data  indicating  that  a  dis¬ 
infectant  may  not  be  effective  as  registered  when  registrants  are  aware 
that  such  data  exist.^  Evidence  exists  that  some  registrants  have  sub¬ 
mitted  to  ERA  efficacy  test  data  indicating  that  their  disinfectants  work 
but  may  have  withheld  other  test  data  indicating  that  these  disinfec¬ 
tants  do  not  work  as  claimed.  Furthermore,  if  a  registrant  deliberately 


^Section  6(aX2)  of  FIFRA  states: 

“If  at  any  time  after  the  registration  of  a  pesticide  the  registrant  has  additional  factual  information 
regarding  unreasonable  adverse  effects  on  the  environment  of  the  pesticide,  he  shall  submit  such 
information  to  the  Administrator.”  7  U.S.C.  sec.  136d(aX2). 

As  interpreted  by  ERA,  “unreasonable  adverse  effects  on  the  environment”  include  information  con¬ 
cerning  the  efficacy  of  disinfectants.  Under  an  ERA  regulation,  40  C.F.R.  sec.  162.50(fX3),  an  appli¬ 
cant  for  registration  also  must  submit  any  Information  that  would  be  required  under  sec.  6(aX2)  if 
the  product  were  registered. 
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submitted  invalid  data  to  epa,  or  a  commercial  lab  deliberately  sub¬ 
mitted  invalid  data  to  a  registrant,  epa’s  data  reviewers,  lab  inspectors, 
and  data  auditors  probably  would  be  unable  to  tell. 

Although  EPA  maintains  that  fifra  prohibits  registrants  from  submitting 
selective  data,  EPA-recommended  methods  for  testing  disinfectant  effi¬ 
cacy  provide  registrants  with  an  opportunity  to  submit  efficacy  data 
selectively.  Given  the  alleged  variability  in  certain  disinfectant  efficacy 
tests  (see  ch.  2),  a  registrant  and/or  testing  facility  could  run  an  efficacy 
test  repeatedly  until  the  formulation  tested  passed,  and  the  registrant 
could  submit  only  the  passing  results  to  epa  (i.e.,  a  registrant  could 
submit  selective  data  to  era). 

Despite  this  opportunity,  era’s  existing  programs  for  validating  efficacy 
data  generally  do  not  enable  era  to  recognize  selective  data.  According 
to  the  Head,  Efficacy  Evaluation  and  Technical  Management  Section, 
Antimicrobial  Program  Branch,  data  reviewers  cannot  identify  situa¬ 
tions  in  which  era  has  received  selective  data  because  the  reviewer  sees 
only  what  was  submitted  rather  than  all  tests  conducted  on  a  disinfec¬ 
tant.  According  to  era’s  five  efficacy  data  auditors,  data  auditors  gener¬ 
ally  cannot  identify  cases  in  which  registration  data  are  selective.  The 
auditors  told  us  that  they  rely  on  labs  to  identify  the  records  they 
should  audit,  and  labs  could  provide  them  with  selective  records. 

During  the  course  of  our  review,  we  found  some  evidence  that  regis¬ 
trants  have  submitted  selective  data  to  era.  For  example,  one  data 
auditor  found  evidence  of  selective  data  during  a  data  audit — passing 
and  failing  data  on  a  high-volume,  household  product  whose  registration 
file  contained  only  passing  data.  According  to  the  data  auditor,  he  found 
the  set  of  failure  data  by  chance.  The  data  auditor  who  discovered  the 
set  of  failure  data  and  other  efficacy  data  auditors  told  us  that  they 
would  have  no  way  of  knowing  if  a  registrant  withheld  data  from  an 
audit.  In  addition,  representatives  of  two  registrants  told  us  that  they 
had  obtained  variable  (both  pass  and  fail)  efficacy  results  on  disinfec¬ 
tants  but  had  submitted  only  passing  results. 

The  belief  that  registrants  submit  selective  data  to  era  is  widespread. 
The  Chief,  era  Antimicrobial  Program  Branch,  and  the  Head  of  the 
branch’s  Efficacy  Evaluation  and  Technical  Management  Section  told  us 
they  believe  that  registrants  submit  selective  data,  and  era’s  June  1990 
disinfectant  program  strategy  paper  stated  that  “the  practice  of  not 
reporting  failing/adverse  test  results  is  widespread.”  In  addition,  other 
ERA  officials,  state  officials,  the  UNC  researchers,  and  others  all  told  us 
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that  they  believe  some  registrants  submit  selective  data.  In  fact,  mem¬ 
bers  of  the  disinfectant  industry  openly  joked  about  submitting  selective 
data  to  EPA  at  a  widely  attended  national  meeting  on  disinfectant  effi¬ 
cacy  test  methods  that  we  and  epa  officials  attended  in  1989.  As  noted 
in  chapter  2,  registrants  have  argued  that  the  existing  test  methods 
yield  variable  results  and  the  performance  standards  are  too  stringent. 
However,  these  criticisms,  and  the  fact  that  epa  rarely  receives  data 
showing  that  disinfectants  do  not  work,  suggest  the  possibility  that 
some  registrants  could  have  submitted  selective  data  to  epa  to  register 
their  products. 

Even  if  the  variabilities  in  the  test  methods  were  reduced  to  limit  a  reg¬ 
istrant’s  opportunity  to  submit  selective  data,  neither  lab  inspectors  nor 
data  auditors  can  practically  observe  these  tests  in  progress,  and  no 
physical  evidence  (e.g.,  test  tubes)  remains  from  the  tests  once  they  are 
completed.  As  a  result,  data  reviewers  and  auditors  must  rely  on  the 
registrant’s  word  about  the  procedures  followed  in  a  test,  the  disinfec¬ 
tant  formulation  tested,  and  the  test  results,  according  to  epa  officials. 

In  the  event  that  a  registrant  or  lab  facility  were  deliberately  to  deviate 
from  an  EPA-approved  efficacy  test  method  (e.g.,  by  running  the  test  at  a 
higher  temperature  than  reported);  run  a  test  with  a  disinfectant  formu¬ 
lation  that  would  pass  the  test,  rather  than  the  formulation  the  regis¬ 
trant  planned  to  market;  or  record  that  a  disinfectant  formulation 
passed  an  efficacy  test  when  the  formulation  failed,  data  reviewers  or 
auditors  probably  would  not  be  in  a  position  to  identify  the  deviation 
and  question  the  test  results. 

Although  a  program  to  test  disinfectants  before  registering  them  could 
resolve  these  issues,  epa  does  not  currently  operate  such  a  program.  At 
one  time,  epa  operated  a  limited  preregistration-testing  program  to 
verify  sporicidal  claims  and  selected  tuberculocidal  claims,  era  discon¬ 
tinued  preregistration  tuberculocidal  testing  in  1979  because  of  inconsis¬ 
tent  test  results  and  discontinued  all  other  preregistration  tests  in  1982. 
era’s  records  from  the  testing  program  show  that  at  least  some  regis¬ 
trants  changed  proposed  efficacy  claims  on  the  basis  of  era’s  tests  to 
make  them  more  protective  (e.g.,  lengthened  contact  times).  For 
example,  one  registrant  lengthened  its  proposed  exposure  period  for  the 
sporicidal  efficacy  of  a  disinfectant  from  6  hours  to  10  hours  in  1974 
after  the  disinfectant  failed  a  preregistration  test,  era  would  not  need  to 
test  all  disinfectants  for  efficacy  before  registering  them.  Instead,  era 
could  target  such  a  program  to  those  disinfectant  claims  of  greatest 
importance  to  public  health,  such  as  sporicidal  claims,  to  those  products 
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with  suspected  efficacy  problems,  and/or  to  other  products  as  deter¬ 
mined  by  the  Administrator. 


Internal  Controls 
Inadequate 


EPA’s  inability  to  ensure  the  quality  and  integrity  of  registrant-submitted 
disinfectant  efficacy  data  is,  in  our  opinion,  a  material  weakness  in 
internal  controls  under  fmfia.  Under  fmfia,  each  federal  agency  must 
establish  and  maintain  a  system  of  internal  controls  to  provide  reason¬ 
able  assurance  that,  among  other  things,  program  and  administrative 
activities  are  effectively  managed  to  achieve  the  goals  of  the  agency. 

GAO  and  the  Office  of  Management  and  Budget  guidance  on  internal  con¬ 
trols  require  agencies  to  identify,  in  writing,  objectives  for  each  agency 
activity  that  are  specific,  complete,  logical,  and  applicable  to  the  specific 
activity;  as  well  as  techniques  that  will  provide  reasonable  assurance 
that  the  objectives  will  be  accomplished.  In  addition,  federal  agencies 
are  required  to  identify,  in  an  annual  report  to  the  President,  material 
weaknesses  in  internal  controls.  A  material  weakness  exists  in  an 
agency’s  internal  control  systems  when,  among  other  things,  the  agency 
lacks  reasonable  assurance  that  the  objectives  of  the  system  are  being 
accomplished  and  that  the  weakness  would  significantly  impair  the  ful¬ 
fillment  of  the  agency’s  mission  and/or  would  deprive  the  public  of  a 
needed  service. 


Conclusions 


ERA  relies  on  registrant-submitted  data  to  support  disinfectant  efficacy 
claims.  As  noted  in  chapter  2,  we  found  that  the  validity  of  disinfectant 
efficacy  methods  and  performance  standards  has  been  questioned  and 
that  era’s  process  for  accepting  test  methods  is  inadequate.  However, 
even  if  era  addressed  these  problems,  we  believe  that  era  still  would 
lack  sufficient  controls  to  ensure  the  quality  and  integrity  of  registrant- 
submitted  disinfectant  efficacy  data. 

We  found  a  number  of  weaknesses  in  the  data  review,  lab  inspection, 
and  data  audit  programs.  First,  era  has  not  identified  all  labs  that  have 
performed  disinfectant  efficacy  studies  to  be  inspected/audited,  era 
should  use  the  Pesticide  Document  Management  System  which,  though 
limited,  contains  the  best  available  information  for  identifying  these 
labs.  Second,  era’s  lab  inspection  and  data  audit  programs  are  unable  to 
completely  assess  the  capabilities  of  labs  that  perform  disinfectant  effi¬ 
cacy  tests  because  these  tests  are  operator-sensitive  and  inspectors/ 
auditors  generally  do  not  observe  them  in  progress.  A  check  sample  pro¬ 
gram  could  provide  era  with  greater  assurance  that  laboratories  that 
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perform  these  tests  for  registrants  are  capable  of  performing  them  cor¬ 
rectly.  Third,  epa  has  been  slow  to  prepare  and  process  reports  from 
inspections/audits  related  to  disinfectant  efficacy  studies.  The  timeli¬ 
ness  of  these  reports  is  more  important  now  that  epa’s  glp  regulations 
encompass  disinfectant  efficacy  studies.  A  review  of  ocm’s  internal  con¬ 
trols  for  ensuring  that  inspections/audits  are  processed  on  time  could 
prevent  problems  with  timeliness  in  the  future.  Fourth,  epa  has  not  pub¬ 
lished  guidelines  needed  to  ensure  that  data  reviewers,  lab  inspectors, 
and  data  auditors  identify  all  potential  problems  with  disinfectant  effi¬ 
cacy  studies  and  that  epa  takes  appropriate  registration  and/or  enforce¬ 
ment  action. 

Although  EPA  can  improve  its  data  review,  lab  inspection,  and  data  audit 
programs,  we  believe  that  the  only  way  for  era  to  determine  whether  a 
registrant  has  submitted  selective  data  or  has  deliberately  submitted 
invalid  data  is  by  testing  the  product.  Evidence  exists  to  suggest  that,  in 
at  least  some  cases,  pre-registration  government  tests  to  verify 
sporicidal  efficacy  data  led  to  more  protective  label  claims.  We  are  not 
suggesting  that  epa  test  all  disinfectants  for  efficacy  before  registering 
them.  Instead,  era  could  target  such  a  program  to  those  disinfectant 
claims  of  greatest  importance  to  public  health  and/or  products  with  sus¬ 
pected  efficacy  problems.  Data  reviews,  lab  inspections,  and  data  audits 
cannot  ensure  the  integrity  of  registrant-submitted  data.  A  preregistra¬ 
tion-testing  program  would  complement  those  activities  and  better 
ensure  the  integrity  of  the  data. 

We  believe  that  era’s  lack  of  sufficient  controls  to  ensure  the  quality  and 
integrity  of  registrant-submitted  disinfectant  efficacy  studies  is  a  mate¬ 
rial  weakness  in  era’s  internal  controls  that  should  be,  but  has  not  been, 
reported  to  the  President  as  required  by  fmfia.  Until  this  weakness  is 
corrected,  epa  may  be  compromising  public  health  by  registering  ineffec¬ 
tive  products. 


Recommendations 


To  improve  era  controls  over  the  quality  and  integrity  of  registrant-sub¬ 
mitted  data,  we  recommend  that  the  Administrator,  epa,  implement  a 
preregistration-testing  program  to  verify  selected  disinfectant  efficacy 
data.  (See  ch.  5  for  a  discussion  of  options  for  establishing  a  laboratory 
facility  to  assist  in  such  a  program.)  The  Administrator  could  target  pre¬ 
registration  tests  on  those  claims  that  are  of  the  greatest  public  health 
significance  and/or  products  with  suspected  efficacy  problems. 
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To  improve  the  effectiveness  of  the  data  review,  lab  inspection,  and 
data  audit  programs,  we  recommend  that  the  Administrator,  epa, 

•  direct  the  Laboratory  Data  Integrity  Assurance  Division  to  identify  all 
laboratories  that  have  performed  efficacy  studies  submitted  to  epa  to 
support  disinfectant  registrations  and  meet  the  division’s  goal  of 
inspecting  these  labs  at  least  every  2  years  (at  a  minimum,  direct  ldiad 
to  use  the  Office  of  Pesticide  Programs  Pesticide  Document  Management 
System,  which  contains  the  best  available  information  for  identifying 
the  labs); 

•  direct  ldiad  to  establish  a  check  sample  program  as  part  of  the  lab 
inspection  program  to  better  assess  the  ability  of  labs  to  perform  disin¬ 
fectant  efficacy  tests; 

•  direct  the  Office  of  Compliance  Monitoring  to  review  its  internal  con¬ 
trols  for  ensuring  that  inspections/audits  are  processed  on  time  (for 
example,  ensure  that  inspectors/auditors  are  held  accountable  in  their 
performance  standards  and  appraisals  for  meeting  processing  time 
frames);  and 

•  direct  the  Office  of  Pesticide  Programs  and  the  Office  of  Compliance 
Monitoring  to  develop  and  implement  specific  guidance  for  data 
reviewers,  lab  inspectors,  and  data  auditors  to  follow;  further,  direct 
these  offices  to  develop,  publish  for  comment,  and  implement  detailed 
policies  and  guidelines  to  decide  what  registration  and/or  enforcement 
action  to  take  on  the  basis  of  findings  from  lab  inspections  and  data 
audits. 

We  recommend  that  in  his  next  annual  internal  control  report  to  the 
President,  the  Administrator,  era,  report  the  lack  of  sufficient  controls 
to  ensure  the  quality  and  integrity  of  registrant-submitted  disinfectant 
efficacy  data  as  a  material  weakness.  We  also  recommend  that  the 
Administrator,  era,  include  in  his  report  a  plan  delineating  specific  cor¬ 
rective  actions  and  time  frames. 
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Even  were  epa  to  implement  improvements  in  its  processes  for  regis¬ 
tering  efficacy  claims  (e.g.,  independent  validation  of  test  methods  and 
preregistration  testing),  these  improvements  would  not  provide  suffi¬ 
cient  assurance  that  disinfectants  on  the  market  were  effective.  Regis¬ 
trants  could,  intentionally  or  inadvertently,  manufacture  and  sell 
ineffective  batches  of  disinfectants  after  registering  them,  epa  lacks 
assurance  that,  once  registered,  disinfectants  work  as  claimed  because 
EPA  stopped  monitoring  disinfectants  on  the  market  for  efficacy  in  1982 
Because  states  and  disinfectant  users  generally  do  not  monitor  disinfec¬ 
tants  for  efficacy,  epa  is  relying,  in  effect,  on  the  industry  to  regulate 
itself.  Despite  the  scientific  controversies  over  efficacy  test  results,  his¬ 
torical  enforcement  and  other  data  suggest  that  as  many  as  20  percent 
of  the  disinfectant  batches  on  the  market  do  not  work  as  claimed.  As  a 
result,  disinfectant  users  may  be  placing  themselves  and  others  at  risk 
from  infection  and  spending  money  unnecessarily. 


Federal  Enforcement 
Testing  Discontinued 


Until  1982,  epa  operated  a  limited  post-registration  testing  program  to 
verify  certain  efficacy  claims  of  marketed  disinfectants  at  its  laboratory 
facilities  in  Beltsville,  Maryland.  According  to  the  best  available  infor¬ 
mation,  the  program  was  limited  in  size,  scope,  and  operation,  epa  dis¬ 
continued  the  program  because  of  budget  constraints  and  expected  that 
states,  users,  and  the  disinfectants  industry  would  assume  most  of  its 
responsibility  for  ensuring  the  efficacy  of  marketed  disinfectants.^ 


From  1970,  after  epa  was  established  and  took  over  the  pesticide  pro¬ 
grams  from  the  U.S.  Department  of  Agriculture,  through  1982,  the  Belts¬ 
ville  laboratory  tested,  on  average,  207  disinfectant  samples  annually. 
However,  the  number  of  samples  tested  each  year  dropped  substantially 
after  1972.  From  1970  through  1972,  the  laboratory  tested  an  average 
of  610  samples  annually.  By  contrast,  from  1973  through  1982,  the  labo¬ 
ratory  tested  an  average  of  127  samples  annually,  testing  only  47  sam¬ 
ples  in  1982.  Furthermore,  the  Beltsville  laboratory  did  not  verify  all 
types  of  efficacy  claims.  According  to  the  microbiologist  at  the  labora¬ 
tory,  the  laboratory  tested  no  products  from  the  marketplace  for 
sporicidal  claims  and,  after  the  mid-1970s,  few  products  for  use  on  sur¬ 
faces  other  than  hard  surfaces. 


'Although  EPA  discontinued  post-registration  testing,  it  kept  the  Beltsville  laboratory  open  for  use  on 
an  as-needed  basis  (e.g.,  to  perform  confirmatory  efficacy  tests  on  disinfectant  enforcement  samples 
from  the  states). 
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According  to  epa  congressional  testimony,  era  discontinued  its  post-reg¬ 
istration  testing  program  primarily  because  (1)  the  level  of  testing  was 
inadequate  and  was  creating  a  false  sense  of  security  among  users  and 
the  public  about  the  efficacy  of  disinfectants  on  the  market  and  (2) 
budget  constraints  prevented  era  from  conducting  what  it  considered  to 
be  an  adequate  level  of  testing,  era  officials  believed  that  by  discontin¬ 
uing  the  testing,  era  could  direct  more  time  and  effort  to  evaluating  and 
improving  the  test  methods,  era  officials  believed  that  the  states,  the 
user  community,  and  the  disinfectants  industry  would  take  a  more 
active  role  in  monitoring  the  efficacy  of  disinfectants  on  the  market  and 
that  ERA  could  establish  a  system  for  processing  complaints  from  these 
sources  about  actual  or  suspected  product  failures. 

However,  era  had  little  reason  to  expect  that  states  and  disinfectant 
users  would  assume  era’s  responsibility  for  monitoring  disinfectant  effi¬ 
cacy  or  to  assume  that  a  complaint  system  would  be  developed  because 
of  a  lack  of  era  leadership.  Few  states  and  no  users  were  testing  at  the 
time,  and  no  others  expressed  an  interest  in  testing.  In  addition,  without 
a  laboratory  facility  or  provision  to  contract  for  laboratory  services,  era 
had  no  mechanism  for  channelling  and  verifying  complaints  about 
potentially  ineffective  disinfectants  from  the  states,  user  groups,  and 
the  industry  and  for  initiating  appropriate  enforcement  action  against 
disinfectants  found  to  be  ineffective. 


Nonfederal  Testing 
Limited 


Although  ERA  discontinued  its  efficacy-monitoring  program  in  1982, 
nonfederal  monitoring  efforts  remain  limited.  As  of  July  1989,  we  were 
able  to  identify  only  three  states — Florida,  North  Carolina,  and  Missis¬ 
sippi — that  were  monitoring  the  efficacy  of  disinfectants  in  the  market¬ 
place  under  their  pesticide  enforcement  programs  and  only  two  states — 
Wisconsin  and  Virginia — that  were  testing  disinfectants  under  other 
state  programs.  Furthermore,  we  did  not  identify  any  users  or  related 
groups,  including  the  health-care,  restaurant,  or  food-processing  indus¬ 
tries,  that  have  implemented  comprehensive,  routine  monitoring  pro¬ 
grams.  In  effect,  era  has  left  the  burden  of  monitoring  disinfectant 
efficacy  to  the  industry  itself. 


State  Testing  Limited  Although  Florida,  North  Carolina,  and  Mississippi  monitor  the  efficacy 

°  of  disinfectants  on  the  market,  the  scope  of  their  testing  programs  and 

authority  of  their  enforcement  programs  are  limited,  and  the  amount  of 
testing  they  have  performed  has  decreased  in  recent  years.  In  addition. 
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scientific  controversies  surrounding  the  test  methods  have  affected 
their  efforts  to  enforce  the  efficacy  of  disinfectants  on  the  market. 

The  types  and  amounts  of  enforcement  testing  the  states  perform  is  lim¬ 
ited.  Florida,  North  Carolina,  and  Mississippi  do  not  verify  all  types  of 
disinfectant  efficacy  claims.  For  example,  none  tests  products  for 
sporicidal,  tuberculocidal,  or  virucidal  efficacy.  According  to  officials  in 
these  states,  the  tests  are  too  time-consuming  and  expensive.  Further¬ 
more,  the  total  amount  of  enforcement  testing  these  states  have  per¬ 
formed  has  been  dropping  overall  since  epa  discontinued  its  testing 
program.  The  total  number  of  samples  the  states  tested  decreased  from 
962  in  1985  to  500  in  1989.  (See  fig.  4.1.)  The  state  of  Mississippi  has 
virtually  discontinued  testing.  In  fiscal  year  1989,  the  state  tested  only 
14  disinfectant  samples  for  efficacy. 
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Samples  Tested  by  North  Carolina, 
Florida,  and  Mississippi,  1983-89 
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Mississippi 
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Florida  and  Mississippi  data  are  for  fiscal  years  (July  1  through  June  30).  North  Carolina  data  are  for 
calendar  years. 

Source:  Prepared  by  GAO  on  the  basis  of  data  from  the  states  of  North  Carolina,  Florida,  and 
Mississippi, 


To  some  extent,  the  scientific  controversies  surrounding  the  test 
methods  and  performance  standards  have  affected  the  states’  efforts  to 
enforce  the  efficacy  of  disinfectants  on  the  market.  For  example,  the 
state  of  Florida  has  not  attempted  to  issue  complaints  against  any  regis¬ 
trant  whose  disinfectants  have  failed  efficacy  tests  since  1986. 
According  to  the  Director,  Florida  Division  of  Inspection,  the  state  does 
not  feel  comfortable  basing  legal  action  on  results  from  efficacy  tests 
until  controversies  surrounding  the  aqac  Use-Dilution  Method  are 
resolved. 

Although  Florida,  North  Carolina,  and  Mississippi  have  tested  and  failed 
at  least  some  disinfectants  registered  for  use  in  other  states,  states  do 
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not  have  authority  to  regulate  the  efficacy  of  disinfectants  in  the  mar¬ 
ketplace  outside  of  their  boundaries.  In  at  least  two  cases,  registrants 
have  responded  to  state  enforcement  action  by  recalling  disinfectants 
from  the  marketplace  and  disinfectant  users  within  the  state  or  by 
deleting  specific  efficacy  claims  from  disinfectant  labels,  but  have  con¬ 
tinued  to  market  the  disinfectants  or  make  the  claims  in  other  states.  In 
one  case,  a  producer  agreed  to  recall  from  a  single  state  market  a  phe¬ 
nolic-based  disinfectant  marketed  under  nine  different  brand  names 
after  the  product  failed  state  efficacy  tests.  However,  the  disinfectant, 
which  is  registered  for  use  on  floors,  walls,  and  other  hard  surfaces  in 
hospitals,  nurseries,  rest  rooms,  telephone  booths,  and  elsewhere,  con¬ 
tinues  to  be  sold  in  all  other  states,  according  to  the  registrant’s  cus¬ 
tomer  service  representative.  In  the  other  case,  the  registrant  of  two 
nationally  marketed  disinfectants  removed  claims  that  the  products 
were  effective  in  hard  water  from  the  product  labels  in  one  state  after 
one  of  the  products  failed  state  efficacy  tests.  However,  the  registrant 
continues  to  market  the  two  products  (one  of  which  is  for  use  on  floors, 
walls,  basins,  and  on  instruments  in  hospitals,  nursing  homes,  schools, 
and  medical  and  dental  offices)  with  the  claims  in  other  states, 
according  to  the  registrant’s  customer  service  representative. 

States  other  than  Florida,  North  Carolina,  and  Mississippi  have  been 
reluctant  to  start  testing  programs.  We  interviewed  officials  from  sev¬ 
eral  of  the  states  with  high  pesticide  enforcement  funding  from  epa  and/ 
or  a  high  number  of  disinfectant  producers  located  within  their  bounda¬ 
ries.  The  most  common  reason  they  offered  for  not  operating  testing 
programs  was  that  they  do  not  have  the  resources  needed  to  establish 
and  operate  a  testing  facility.  Although  era  has  provided  most  states 
with  funding  for  pesticide  enforcement  activities,  the  amount  of  funding 
decreased  by  about  25  percent  in  real  terms  (i.e.,  after  adjusting  for 
changes  in  price  levels)  from  federal  fiscal  year  1983  to  1989,  and, 
according  to  the  Chief,  epa  Grants  and  Evaluation  Branch,  era  has  not 
required  the  states  to  make  disinfectant  efficacy  testing  a  pesticide 
enforcement  priority.  Instead  of  a  testing  program,  most  of  these  state 
officials  said  they  rely  on  era’s  judgment  in  registering  disinfectants  as 
assurance  that  they  are  effective. 

The  states  of  Wisconsin  and  Virginia  operate  testing  programs  but  not 
under  their  pesticide  enforcement  programs.  The  Wisconsin  Department 
of  Health  and  Social  Services  requires  the  efficacy  of  sanitizers  intended 
for  use  on  food  contact  surfaces  (except  those  containing  inorganic 
hypochlorites)  to  be  tested  under  its  program  to  regulate  the  milk  and 
restaurant  industries.  The  Commonwealth  of  Virginia  discontinued  an 
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enforcement  testing  program  sometime  around  1982  because,  according 
to  the  Supervisor,  Virginia  Office  of  Pesticide  Regulation,  the  state 
found  that  the  aoac  Use-Dilution  Method  did  not  yield  results  that  were 
reproducible  enough  to  take  enforcement  action  against  registrants 
whose  samples  failed  the  test.  Despite  problems  with  the  method,  the 
state  has  continued  to  test  disinfectant  samples  that  manufacturers 
submit  in  order  to  compete  for  state  contracts  for  some  types  of  efficacy 
claims. 


User  Programs  Not 
Established 


Individuals  and  organizations  both  within  and  outside  of  the  health-care 
industry  told  us  that  they  were  not  aware  of  any  hospitals,  doctors,  or 
dentists  that  test  disinfectants  for  efficacy.  According  to  several  health¬ 
care  representatives,  hospitals  and  other  users  do  not  have  the 
resources  and/or  the  expertise  necessary  to  operate  a  program  to  mon¬ 
itor  the  efficacy  of  disinfectants  on  the  market.  Instead,  they  rely  on 
era’s  registration  of  disinfectants  as  assurance  that  disinfectants  on  the 
market  are  effective.  Furthermore,  restaurants  and  food-processing 
facilities  do  not  test  the  sanitizers  they  use  for  efficacy,  according  to 
representatives  from  these  industries. 

Some  researchers  affiliated  with  users  (as  well  as  others)  have  tested 
disinfectants,  or  are  planning  to  test  disinfectants,  but  have  not  estab¬ 
lished  monitoring  programs.  For  example,  since  1976,  Clinical  Research 
Associates,  an  independent  research  organization  dedicated  to  evalu¬ 
ating  dental  materials,  devices,  and  concepts,  has  been  testing  the  effi¬ 
cacy  of  selected  disinfectants  used  by  dentists.  As  of  February  1990,  we 
had  identified  two  organizations,  the  American  Dental  Association  (ada) 
and  the  National  Sanitation  Foundation  (nsf),  that  were  considering 
testing  disinfectants  for  efficacy.  However,  if  ada  were  to  test  disinfec¬ 
tants,  ADA  would  only  test  tuberculocidal  disinfectants  and  would  not 
test  products  routinely.  Moreover,  both  programs  would  depend  on  vol- 
imtary  participation  by  registrants. 

Although  several  individuals  and  organizations  affiliated  with  disinfec¬ 
tant  users  have  complained  or  submitted  data  to  era  indicating  that  spe¬ 
cific  disinfectants  do  not  work  as  claimed,  era  has  not  established  the 
system  for  processing  these  complaints  that  it  proposed  as  part  of  its 
1987  disinfectant  program  improvement  strategy.  Furthermore,  era  has 
not  yet  addressed  the  question  of  how  it  would  verify  the  complaints 
and  take  appropriate  enforcement  action  against  disinfectants  foimd  to 
be  ineffective. 
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Industry  Self-Regulation 
Limited 


The  burden  of  monitoring  the  efficacy  of  disinfectants  has  fallen  on  the 
industry  itself  because  epa  no  longer  tests  disinfectants,  few  states  test 
and  their  programs  are  limited,  users  do  not  generally  test,  and  epa  lacks 
an  effective  complaint  system.  However,  market  forces  cannot  be  relied 
upon  to  control  disinfectant  efficacy  problems  because  users  cannot 
visually  identify  ineffective  products.  Furthermore,  although  regis¬ 
trants  can  test  competitors’  products  and  have  challenged  competitors’ 
claims,  epa  has  been  unable  to  resolve  conflicting  claims  because  it  lacks 
the  laboratory  facilities  necessary  to  do  so,  according  to  the  Chief,  Anti¬ 
microbial  Program  Branch.  Consequently,  industry  self-regulation 
appears  limited.  A  June  1990  update  to  epa’s  June  1987  strategy  paper 
on  improving  the  disinfectant  program  acknowledged  that  some  regis¬ 
trants  make  unregistered  and/or  exaggerated  efficacy  claims  for  disin¬ 
fectants  and  that  some  registrants  market  unregistered  disinfectants. 


Some  Marketed 
Disinfectants  May  Be 
Ineffective 


Although  the  scientific  controversies  surrounding  disinfectant  efficacy 
test  results  discussed  in  chapter  2  cloud  the  issue  somewhat,  historical 
data  on  specific  products  from  era  and  the  states,  along  with  data  from 
industry,  academia,  and  other  sources,  indicate  that  some  disinfectants 
on  the  market  are  ineffective.  Although  the  true  percentage  of  ineffec¬ 
tive  disinfectants  on  the  market  is  unknown,  era  acknowledged  in  1983 
that  as  many  as  20  percent  of  marketed  disinfectants  may  be  ineffec¬ 
tive.  Consequently,  public  health  and  consumer  welfare  may  be  at  risk 
from  disinfectants  that  do  not  work  as  claimed. 


Historical  test-failure  data  indicate  that  era  and  the  states  have  been 
unable  to  substantiate  disinfectant  claims  for  certain  products.  Between 
1978  and  1982,  the  last  6  years  during  which  era  tested  disinfectants,  an 
average  of  42  percent  of  sdl  disinfectant  samples  tested  by  the  lab  failed 
efficacy  tests.  In  the  years  since  the  era  lab  closed  (1983-89),  22  percent, 
4  percent,  and  2  percent  of  all  disinfectant  samples  tested  by  the  states 
of  Florida,  North  Carolina,  and  Mississippi,  respectively,  have  failed 
efficacy  tests.  During  1988  and  1989,  about  30  percent  of  all  sanitizer 
samples  tested  under  the  state  of  Wisconsin  program  failed,  and  about 
40  percent  of  the  samples  tested  by  the  Commonwealth  of  Virginia 
failed. 

Although  many  products  have  failed  disinfectant  efficacy  tests  in  era’s 
and  the  states’  laboratories,  the  data  generally  are  not  comparable.  More 
specifically,  era  and  the  states  have  used  different  schemes  for  sampling 
disinfectants  from  the  marketplace,  used  different  performance  stan¬ 
dards  to  assess  efficacy,  and  tested  different  types  of  claims.  For 
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example,  Florida  has  focused  on  sampling  and  testing  disinfectants  that 
frequently  fail  efficacy  tests  and/or  are  intended  for  hospital  use, 
whereas  Mississippi  has  tested  products  at  random  from  the  market¬ 
place.  North  Carolina  and  Florida  have  used  pass-fail  criteria  for  disin¬ 
fectants  in  efficacy  tests  that  are  more  lenient  than  epa’s  registration 
standards.  Mississippi  has  not  tested  disinfectants  for  efficacy  in  the 
presence  of  organic  matter,  while  Florida  has.  Virginia  tests  disinfec¬ 
tants  to  deternune  whether  they  are  effective  in  hard  water  and  in  the 
presence  of  organic  matter  regardless  of  whether  the  products  are  regis¬ 
tered  with  those  claims. 

While  the  data  from  state  and  federal  enforcement  testing  are  not  com¬ 
parable,  they  suggest  that  an  unknown  number  of  disinfectants  on  the 
market  may  be  ineffective.  Some  disinfectants  have  failed  enforcement 
tests  by  a  wide  margin.  At  least  two  states  have  found  disinfectants  con¬ 
taminated  with  bacteria.  Some  disinfectants  have  failed  efficacy  tests 
repeatedly  in  a  single  state,  in  multiple  regulatory  labs  (state  and/or 
EPA),  or  tests  performed  by  registrants  themselves  at  regulatory  labs. 

For  example,  a  disinfectant  registered  for  use  on  floors,  walls,  showers, 
and  other  surfaces  in  hospitals,  nursing  homes,  and  schools  failed  effi¬ 
cacy  tests  on  multiple  occasions  in  era’s  lab  and  two  state  laboratories. 
Similarly,  a  disinfectant  registered  for  use  in  hospitals,  nursing  homes, 
food-processing  facilities,  office  buildings,  schools  and  recreation  facili¬ 
ties  failed  28  efficacy  tests  in  one  state  from  1983  to  1988. 

In  addition,  data  from  industry,  academia,  and  others  also  raise  ques¬ 
tions  about  whether  some  disinfectant  batches  in  the  marketplace  work 
as  claimed  on  their  labels.  For  example,  in  a  collaborative  study  of  the 
AOAC  Use-Dilution  Method,  three  of  four  disinfectant  manufacturers’  lab¬ 
oratories  unknowingly  tested  and  failed  their  own  products. 

While  several  officials  from  epa,  industry,  and  the  states,  and  most 
others  we  talked  to  believe  that  disinfectants  on  the  market  are  gener¬ 
ally  effective,  various  sources  estimate  that  between  6  to  20  percent  of 
disinfectants  on  the  market  do  not  work  as  claimed,  era  officials,  them¬ 
selves,  believe  that  some  disinfectants  on  the  market  may  be  ineffective. 
In  1983,  the  Director  of  the  Compliance  Monitoring  Staff  (now  the  Office 
of  Compliance  Monitoring)  estimated  that  a  random  sample  of  disinfec¬ 
tants  would  reveal  a  failure  rate  of  up  to  20  percent.  He  concluded  that, 
“This  is  an  unacceptable  rate  of  failure  for  products  with  direct  public 
health  significance.”  In  a  1983  congressional  hearing,  the  Director  of  the 
Office  of  Pesticide  Programs  stated  that,  given  the  types  of  failure  rates 
the  Beltsville  laboratory  had  found,  it  was  apparent  that  many  batches 
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of  ineffective  products  had  reached  the  marketplace  with  the  limited 
level  of  testing  conducted.  Furthermore,  epa  and  state  officials,  as  noted 
in  chapter  2,  have  stated  that  the  conflicting  test  results  obtained  in 
research  on  disinfectant  efficacy  test  methods  may  result  as  much  from 
ineffective  products  as  from  problems  with  the  methods  themselves. 


Conclusions 


EPA  lacks  assurance  that  all  disinfectants  on  the  market  work  as 
claimed.  After  a  disinfectant  is  registered,  its  formulation  could  be 
altered,  intentionally  or  inadvertently,  and  ineffective  batches  intro¬ 
duced  into  the  marketplace.  Although  epa  has  acknowledged  this  possi¬ 
bility,  the  agency  discontinued  its  limited  testing  and  enforcement 
program  in  1982.  Because  state  and  user  monitoring  efforts  are  limited, 
epa’s  decision  to  stop  enforcement  testing  was,  in  effect,  a  decision  to  let 
industry  regulate  the  efficacy  of  marketed  disinfectants.  However,  era 
lacks  a  formal  system  to  channel  complaints  about  potentially  ineffec¬ 
tive  disinfectants  from  competitors,  users,  and  others,  and  to  take 
appropriate  enforcement  action  against  ineffective  disinfectants. 
Greater  leadership  on  era’s  part  to  develop  a  strategy  that  pools 
resources  from  the  states,  user  groups,  industry  and  others  to  identify 
potentially  ineffective  disinfectants  and  that  specifies  the  appropriate 
enforcement  action  against  disinfectants  found  to  be  ineffective,  would 
provide  better  assurance  that  disinfectants  on  the  market  work  as 
claimed.  Without  such  an  enforcement  strategy,  era’s  policy  of  “let  the 
buyer  beware”  for  disinfectants  may  be  compromising  public  health  and 
consumer  protection.  While  we  recognize  that  era  needs  to  resolve  the 
scientific  controversies  that  surround  disinfectant  efficacy  test  methods 
and  performance  standards  (discussed  in  ch.  2),  these  controversies 
should  not  prevent  era  from  establishing  and  implementing  an  enforce¬ 
ment  strategy  to  ensure  the  efficacy  of  disinfectants  in  the  marketplace. 


Recommendations 


We  recommend  that  the  Administrator,  era,  develop,  publish  for  com¬ 
ment,  and  implement  an  enforcement  strategy  to  ensure  that  marketed 
disinfectants  work  as  claimed.  This  strategy  should  specify  (1)  the 
mechanisms  and  procedures  for  identifying  potentially  ineffective  disin¬ 
fectants;  (2)  the  procedures  for  investigating  and  verifying  complaints 
about  potentially  ineffective  disinfectants,  including,  where  necessary, 
the  use  of  independent  laboratory  testing;  and  (3)  the  criteria  and  proce¬ 
dures  for  initiating  registration  and/or  enforcement  action  against  disin¬ 
fectants  found  to  be  ineffective.  In  light  of  federal  budget  constraints, 
we  also  recommend  that  the  Administrator  explore  options  for  pooling 
resources  from  the  states,  user  groups,  and  industry  to  implement  a 
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national  disinfectant  efficacy  enforcement  strategy.  (See  ch.  5  for  a  dis¬ 
cussion  of  options  for  establishing  a  laboratory  facility  to  assist  in  an 
enforcement  program.) 
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Many  people  in  industry,  the  state  regulatory  laboratories,  universities, 
scientific  associations,  user  groups,  and  other  organizations  believe  an 
independent  laboratory  facility  is  needed  to  research  and  selectively  test 
the  efficacy  of  disinfectants.  Some  believe  that  era’s  efforts  to  resolve 
the  scientific  controversies  that  surround  disinfectant  efficacy  test 
methods  may  languish  without  a  federal  laboratory  facility,  era  officials 
have  objected  to  such  a  facility  because  (1)  era  cannot  afford  to  resume 
methodology  research  and  testing  disinfectants  at  its  limited  laboratory 
facility  in  Beltsville,  Maryland,  given  its  limited  budget  and  competing 
pesticide  program  priorities,  and  (2)  they  do  not  think  the  federal  gov¬ 
ernment  should  test  these  products.  However,  fees  charged  for  the  privi¬ 
lege  of  obtaining  a  disinfectant  registration  could  help  offset  the  costs  of 
a  disinfectant  laboratory  facility.  Also,  public  health  may  be  endangered 
without  such  a  resource. 

This  chapter  briefly  identifies  possible  alternatives  for  a  laboratory 
facility,  considering  (1)  the  need  for  and  objectives  of  a  laboratory 
facility,  (2)  suggested  criteria  to  evaluate  alternatives,  (3)  a  list  of  pos¬ 
sible  alternatives,  and  (4)  the  option  of  fees.  The  chapter  is  not  a  cost/ 
benefit  assessment  of  various  alternatives  for  a  disinfectant  laboratory 
facility.  Rather,  the  purpose  of  this  chapter  is  to  briefly  present  the  pros 
and  cons  of  the  alternatives. 


Need  for  and 
Objectives  of  a 
Disinfectant 
Laboratory 


Previous  chapters  in  this  report  discussed  the  need  for  a  laboratory 
facility  to  research  and  test  the  efficacy  of  disinfectants.  Although  their 
opinions  differ,  various  critics  of  era’s  regulation  of  disinfectants  from 
industry,  academia,  user  groups,  and  other  organizations  have  collec¬ 
tively  identified  five  objectives,  listed  below,  of  a  disinfectant  labora¬ 
tory  facility. 

Research  and  development:  the  facility  should  research  and  develop  dis¬ 
infectant  efficacy  test  methods  and  performance  standards  that  are 
accurate  and  precise,  objectively  evaluate  the  validity  of  registrant-pro- 
posed  alternative  methods  and  modifications,  and  actively  participate  in 
the  scientific  exchange  of  information. 

Preregistration  tests:  the  facility  should  conduct  a  preregistration¬ 
testing  program  to  verify  selective  disinfectant  efficacy  claims  and 
ensure  the  quality  and  integrity  of  registrant-submitted  data. 
Laboratory  development:  the  facility  should  improve  and  standardize 
laboratory  procedures,  promote  good  laboratory  practices,  train  labora¬ 
tory  technicians,  and  conduct  a  check  sample  program  to  improve  the 
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Suggested  Criteria  for 

Evaluating 

Alternatives 


capability  of  commercial  and  other  laboratories  conducting  disinfectant 
efficacy  tests. 

Post-registration  tests:  the  facility  should  conduct  a  post-registration 
testing  program  to  verify  selective  disinfectant  efficacy  claims  in  the 
marketplace  and  assist  in  enforcement  cases. 

Reference  laboratory:  the  facility  should  serve  as  the  reference  labora¬ 
tory  on  questions  of  test  methodology  and  procedures,  referee  disputes, 
and  confirm  test  sample  results  from  state  government  laboratories. 

With  respect  to  the  testing  functions,  the  laboratory  facility  would  not 
need  to  test  every  disinfectant  product  or  claim.  Proponents  of  a  disin¬ 
fectant  laboratory  facility  do  not  support  the  idea  of  routine  batch¬ 
testing  to  duplicate  or  replace  manufacturers’  quality  control  programs. 
Rather,  the  laboratory  could  focus  its  efforts  on  those  product  claims 
that  are  of  the  greatest  significance  to  public  health,  such  as  sporicidal 
and  tuberculocidal  claims,  randomly  check  the  efficacy  of  disinfectants 
in  the  marketplace,  and  selectively  target  those  products  or  chemicals 
with  suspected  efficacy  problems. 


Many  factors  or  criteria  could  be  used  to  evaluate  alternatives  for 
meeting  the  objectives  of  a  disinfectant  laboratory  facility  listed  above. 
However,  we  suggest  four  criteria  for  evaluating  alternatives:  (1)  inde¬ 
pendence,  (2)  authority,  (3)  quality,  and  (4)  cost. 

The  need  for  a  laboratory  facility  that  is  independent  has  been  demon¬ 
strated  in  the  scientific  controversies  surrounding  disinfectant  efficacy 
test  methods.  Market  forces  and  competitive  pressures  make  it  difficult 
to  ascertain  the  validity  of  scientific  disputes.  A  laboratory  facility  that 
provides  information  to  epa  on  the  validity  of  disinfectant  efficacy  test 
methods  and  performance  standards  should  be  relatively  isolated  from 
the  profit  motive  of  the  industry.  The  facility  should  be  above  reproach 
to  allegations  of  conflict  of  interest  or  the  appearance  of  such  conflict. 

An  independent  laboratory  facility  needs  the  authority  to  obtain  and 
test  product  samples,  validate  test  methods,  verify  registrants’  claims, 
establish  laboratory  procedures,  and  referee  disputes. 

The  laboratory  facility  and  personnel  should  be  of  high  quality.  The  lab¬ 
oratory  would  be  unable  to  restore  credibility  in  disinfectant  regulation 
if  its  equipment  and  its  personnel  were  not  at  the  forefront  of  microbi¬ 
ology  and  infection  control. 
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Although  all  of  the  criteria  considered  imply  cost  tradeoffs,  the  effi¬ 
ciency  and  practicality  of  each  alternative  must  be  considered.  We  have 
not  prepared  detailed  cost  estimates  for  each  alternative;  rather,  we 
have  considered  whether  the  alternatives  appear  efficient  and  practical. 


Alternatives  for  a 
Laboratory  Facility 


Several  alternatives  or  a  combination  of  alternatives  could  be  developed 
for  operating  a  laboratory  facility  to  test  the  efficacy  of  disinfectants 
and  perform  other  functions.  However,  we  suggest  four  alternatives:  (1) 
the  federal  government,  (2)  a  commercial  laboratory,  (3)  state  govern- 
ment(s),  and  (4)  a  nonprofit  association  or  foundation. 

Many  proponents  of  a  disinfectant  laboratory  facility  support  the  idea 
of  the  federal  government  operating  the  laboratory,  particularly  of  its 
resuming  disinfectant  testing  in  Beltsville,  Maryland.  A  federally  oper¬ 
ated  facility  would  satisfy  the  criterion  of  independence,  epa,  the  most 
likely  agency  to  operate  such  a  lab,  has  the  authority  to  run  it,  but  is  not 
required  to  do  so  under  fifra.  Legislation  has  been  considered  in  pre¬ 
vious  congressional  sessions  to  require  epa  to  establish  standards  for 
disinfectants.  Quality  and  cost  would  be  major  considerations  in  estab¬ 
lishing  a  federal  laboratory,  especially  in  resuming  testing  at  the  Belts¬ 
ville  facility.  Both  epa  and  its  critics  acknowledge  that  epa  would  need 
new,  highly  skilled  personnel  to  operate  a  testing  facility.  In  addition, 
epa’s  existing  facility  would  need  extensive  renovation  because  some  of 
the  equipment  and  supplies  at  the  lab  are  obsolete  and  in  disrepair. 

Cost  estimates  for  establishing  a  federal  disinfectant  laboratory  range 
from  $200,000  to  $2  million;  annual  operating  cost  estimates  range  from 
$300,000  to  $500,000,  depending  on  the  size  and  scope  of  operations. 
Although  we  were  unable  to  find  official  historical  budget  documents 
from  era’s  disinfectant  laboratory,  various  records  in  the  files  indicate 
that  ERA  may  have  spent  upwards  of  $300,000  in  fiscal  year  1981,  the 
year  before  the  laboratory  stopped  testing  disinfectants.  This  amount 
may  not  cover  the  costs  of  a  federal  laboratory  today  because  of  infla¬ 
tion  and  because  a  testing  program  today  may  be  larger  in  scope  and 
size  than  the  one  conducted  by  the  facility  in  1981. 

Although  ERA  currently  is  responsible  for  registering  and  enforcing  the 
efficacy  of  these  products,  several  proponents  of  a  federally  operated 
disinfectant  laboratory  have  suggested  that  the  CDC  or  the  fda  operate 
the  laboratory  either  alone  or  in  cooperation  with  era.  Critics  of  epa 
argue  that  it  lacks  personnel  with  the  expertise  in  infection  control  prac¬ 
tices  necessary  to  effectively  regulate  disinfectants.  They  also  argue 
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that  the  disinfectant  program  will  always  be  of  lower  priority  than 
other  pesticide  programs  within  epa  and  that  perhaps  it  is  a  program 
that  is  misplaced. 

Rather  than  operate  its  own  disinfectant  laboratory,  epa  could  contract 
for  the  necessary  laboratory  services  with  a  commercial  facility.  This 
arrangement  might  offer  era  maximum  flexibility  in  directing  the  focus 
of  work  each  year.  In  addition,  since  the  private  sector  currently  retains 
the  best  available  scientific  and  technical  personnel  and  laboratory 
equipment,  epa  might  be  able  to  contract  for  the  quality  of  services 
needed.  However,  this  alternative  might  sacrifice  independence  if  the 
contract  laboratory  has  or  has  had  a  close  link  with  the  regulated 
industry.  In  addition,  epa  has  been  criticized  frequently  by  the  Congress 
for  contracting  out  too  many  of  its  responsibilities.  (We  did  not  estimate 
how  much  it  would  cost  for  epa  to  contract  out  for  a  disinfectant 
laboratory.) 

A  third  alternative  for  a  disinfectant  laboratory  is  for  the  states  to 
operate  their  own  laboratories.  However,  this  alternative  has  already 
proven  unsuccessful.  Most  states  do  not  operate  a  disinfectant  labora¬ 
tory  today  and  are  unlikely  to  open  labs  in  the  near  future  because  of 
cost  constraints.  Further,  while  the  states  would  be  independent,  they 
would  lack  the  necessary  authority  to  test  products  not  sold  in  their 
state.  Users  and  consumers  would  be  unfairly  disadvantaged  if  their 
states  were  unable  to  afford  a  laboratory  facility  while  neighboring 
states  could  afford  one.  In  addition,  having  50  states  research  improve¬ 
ments  to  disinfectant  efficacy  test  methods  and  test  disinfectants  would 
be  grossly  inefficient. 

A  fourth  alternative  could  be  for  a  nonprofit  association  or  foundation 
to  operate  a  disinfectant  laboratory.  As  discussed  in  chapter  4,  the 
American  Dental  Association  and  the  National  Sanitation  Foundation 
are  considering  whether  and  when  to  establish  their  own  testing  pro¬ 
grams.  While  these  efforts  to  help  protect  public  health  are  commend¬ 
able,  they  may  not  be  able  to  achieve  the  objectives  of  a  disinfectants 
laboratory  outlined  above  because  they  depend  on  registrants  to  volun¬ 
tarily  cooperate  and  submit  their  products  for  testing.  In  addition,  these 
organizations  lack  authority  to  take  any  registration  and/or  enforce¬ 
ment  actions  on  the  basis  of  their  tests. 
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Fees  for  a  Disinfectant 
Laboratory 


Conclusions 


EPA  has  objected  to  resuming  testing  disinfectants  at  its  Beltsville  labora¬ 
tory,  in  part,  because  of  a  lack  of  resources.  However,  fees  might  be  one 
way  to  help  offset  the  costs  of  a  disinfectant  laboratory.  Currently,  the 
1988  amendments  to  fifra  (known  as  fifra  ’88)  prohibit  epa  from 
charging  such  fees.  In  addition,  fees,  which  industry  has  opposed,  pre¬ 
sent  other  obstacles  that  need  to  be  considered. 

era’s  primary  pesticide  program  objective  has  been  to  implement  fifra 
’88,  which  involves  reviewing  the  risks  and  benefits  of  all  pesticides 
first  registered  before  November  1, 1984 — a  process  known  as  “reregis¬ 
tration.”  fifra  ’88  imposes  a  one-time  reregistration  fee  and  an  annual 
maintenance  fee  to  help  offset  the  costs  of  accelerating  reregistration 
and  expediting  new  registrations.  The  fifra  ’88  reregistration  fees  are 
$150,000  per  active  ingredient  but  are  waived  for  small  volume  active 
ingredients  (including  small  volume  disinfectant  active  ingredients)  and 
reduced  for  small  businesses.  The  annual  maintenance  fee  is  designed  to 
provide  about  $14  million  each  year.  The  fifra  ’88  fees  do  not  explicitly 
provide  funds  for  operating  a  disinfectant  laboratory.  Furthermore, 
FIFRA  ’88  prohibits  era  from  charging  other  fees  until  September  30, 
1997,  when  the  fifra  ’88  fee  provisions  expire.  Consequently,  the  Con¬ 
gress  would  have  to  amend  fifra  ’88  to  allow  era  to  charge  disinfectant 
registrants  a  fee  specifically  designated  for  operating  a  disinfectant 
laboratory. 

The  industry  has  opposed  user  fees  for  several  reasons  but  mostly 
because  it  views  product  registrations  as  a  public  rather  than  private 
benefit.  However,  charging  registrants  user  fees  to  finance  a  disinfec¬ 
tant  laboratory,  in  order  for  epa  to  recover  the  costs  of  testing  their 
products,  is  analogous  to  charging  user  fees  for  era  to  accelerate  reregis¬ 
tration  of  older  pesticides  and  expedite  registration  of  new  pesticides. 
Furthermore,  although  fees  would  increase  the  cost  of  registering  and 
marketing  disinfectants,  if  registrants  want  to  market  disinfectants  it 
seems  fair  that  they  finance  the  cost  of  demonstrating  that  their  prod¬ 
ucts  work  as  claimed. 


Earlier  chapters  of  this  report  have  discussed  the  need  for  a  laboratory 
facility  to  research  methods  for  testing  disinfectant  efficacy  and  to  test 
the  efficacy  of  disinfectants.  Several  alternative  ways  exist  for  oper¬ 
ating  a  disinfectant  laboratory,  but  era  lacks  the  resources  needed  to 
finance  such  a  laboratory.  However,  fees  on  disinfectant  registrations 
might  be  one  way  to  help  finance  a  disinfectant  laboratory.  Because  of 
the  statutory  prohibition  on  new  pesticide  registration  fees  and  the 
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unknown  effects  that  disinfectant  fees  might  have  on  the  marketplace, 
what  is  needed  is  a  detailed  cost/benefit  assessment  of  alternatives  for  a 
disinfectant  laboratory,  including  the  option  of  assessing  fees  to  help 
finance  such  a  facility. 


Recommendations 


We  recommend  that  the  Administrator,  era,  develop  a  detailed  cost/ben¬ 
efit  analysis  of  alternatives  for  operating  a  laboratory  facility  to 
research  and  test  the  efficacy  of  disinfectants,  including  the  option  of 
charging  fees  to  register  disinfectants  to  help  finance  such  a  facility,  and 
submit  the  results  of  its  analysis  to  the  Congress  so  that  the  Congress 
may  weigh  the  advantages  and  disadvantages  of  various  alternatives. 
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Affiliations  of  Individuals  GAO  Contacted 

Not  all  individuals  GAO  contacted  officially  represented  these  organiza¬ 
tions,  but  they  were  employed  by  or  affiliated  with  these  organizations. 
Some  of  the  individuals  contacted  from  nongovernmental  organizations 
were  also  employees  of  disinfectant  registrants. 

Federal  Agencies 

Centers  for  Disease  Control 

Environmental  Protection  Agency 

Food  and  Drug  Administration 

State  Governments 

California 

Florida 

Georgia 

Illinois 

Iowa 

Mississippi 

New  York 

North  Carolina 

Texas 

Virginia 

Wisconsin 

Standard-Setting 

Organizations 

American  Society  for  Testing  and  Materials 

Association  of  Official  Analytical  Chemists 

National  Sanitation  Foundation 

Professional  and  Trade 
Associations 

American  Dental  Association 

American  Hospital  Association 

Association  for  Practitioners  in  Infection  Control 

Chemical  Specialties  Manufacturers  Association 

Joint  Commission  on  Accreditation  of  Healthcare  Organizations 

National  Environmental  Health  Association 

National  Food  Processors  Association 

National  Restaurant  Association 

Scientific  Associations 

American  Society  for  Microbiology 

Clinical  Research  Associates 
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Univ6rsities  University  of  Missouri — Columbia 

University  of  North  Carolina  at  Chapel  Hill 


Commercial  Laboratories  Gibraltar  Biological  Laboratories,  Inc. 

Hill  Top  Biolabs,  Inc. 
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Major  Contributx)rs  to  This  Report 


Resources, 
Community,  and 
Economic 

Development  Division, 
Washington,  D.C. 


Peter  F.  Guerrero,  Associate  Director 

J.  Kevin  Donohue,  Assistant  Director 

William  M.  Lay  den,  Evaluator-in-Charge 

Karen  Simpson,  Staff  Evaluator 

Scott  W.  Weaver,  Staff  Evaluator 

Sarah-Ann  Moessbauer,  Operations  Research  Analyst 


Office  of  the  General 
Counsel,  Washington, 
D.C. 


Doreen  Stolzenberg  Feldman,  Senior  Attorney 
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Accuracy 

The  closeness  of  an  observed  result  to  the  true  or  accepted  result. 

Antimicrobial  Pesticides 

With  some  exceptions,  substances  and  mixtures  of  substances,  intended 
for  inhibiting  the  growth  of,  or  destroying  any  bacteria,  fungi  patho¬ 
genic  to  people  and  other  animals;  or  viruses  declared  to  be  pests  and 
existing  in  any  environment.  (For  purposes  of  this  report,  we  have 
referred  to  all  antimicrobial  pesticides  for  public-health  use  as 
“disinfectants.”) 

Bacteria 

Small  microorganisms  with  a  relatively  primitive  cellular  organization. 

Collaborative  Study 

A  study  involving  a  number  of  laboratories  analyzing  the  same  samples 
by  the  same  method  for  the  purpose  of  generating  performance  data  on 
the  method  when  a  competent  analyst  uses  it  exactly  as  written.  (Per¬ 
formance  data  include  any  values  that  indicate  the  reliability,  applica¬ 
bility,  and  practicability  that  can  be  expected  from  the  method.) 

Disinfectant 

As  used  in  this  report,  any  pesticide  used  on  inanimate  surfaces  or 
objects  and  intended  to  inhibit  or  destroy  bacteria,  fungi,  or  spores 
causing  human  disease. 

Efficacy 

The  capacity  of  a  pesticide  product  when  used  according  to  label  direc¬ 
tions  to  control  the  target  pest.  (As  used  in  this  report,  the  term  “effi¬ 
cacy”  is  synonymous  with  the  terms  “product  performance”  and 
“effectiveness.”) 

Fungicide 

As  defined  in  this  report,  a  disinfectant  intended  to  destroy  fungi. 

Fungi 

A  group  of  organisms  devoid  of  chlorophyll  that  cannot  manufacture 
their  own  food. 

Nosocomial  Infection 

An  infection  that  occurs  during  or  sometimes  after  hospitalization  and 
was  not  present  or  incubating  at  the  time  of  the  patient’s  admission. 
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Precision 

Agreement  among  repeat  observations  made  under  the  same  conditions. 

Reliability 

A  criterion  used  to  evaluate  the  validity  of  a  method  by  measuring  the 
method’s  ability,  when  used  by  qualified  analysts,  to  produce  data  of  a 
predictable  degree  of  precision  and  accuracy. 

Repeatability 

The  variability  in  successive  results  obtained  with  the  same  method  on 
identical  test  material  and  under  the  same  conditions  (same  operator, 
same  apparatus,  same  laboratory,  and  same  time). 

Reproducibility 

The  variability  in  individual  results  obtained  with  the  same  method  on 
identical  test  material  but  under  different  conditions  (different  operator, 
different  apparatus,  different  laboratory,  and/or  different  time). 

Sterilizer/Sporicide 

As  defined  in  this  report,  a  disinfectant  intended  to  destroy  or  eliminate 
viruses  and  all  living  bacteria,  fungi,  and  their  spores. 

Tuberculocide 

An  agent  that  is  intended  to  destroy  or  inactivate  tuberculosis  bacteria. 

Viricide 

An  agent  that  is  intended  to  destroy  or  inactivate  one  or  more  species  of 
virus. 

Virus 

Any  of  a  group  of  submicroscopic  infective  agents  that  are  regarded 
either  as  simple  microorganisms  or  as  complex  molecules.  (Viruses  are 
capable  of  growth  and  multiplication  only  in  connection  with  living 
cells.) 
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